-- Logs begin at Mon 2022-08-22 19:28:11 UTC, end at Mon 2022-08-22 21:01:21 UTC. -- Aug 22 20:24:53.501313 dv-osbrick-853789-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 22 20:24:53.510176 dv-osbrick-853789-1-iscsi devstack@keystone.service[81626]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 22 20:24:53.512170 dv-osbrick-853789-1-iscsi devstack@keystone.service[81626]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 22 20:24:53 2022] *** Aug 22 20:24:53.512170 dv-osbrick-853789-1-iscsi devstack@keystone.service[81626]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 22 20:24:53.512170 dv-osbrick-853789-1-iscsi devstack@keystone.service[81626]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 22 20:24:53.512170 dv-osbrick-853789-1-iscsi devstack@keystone.service[81626]: nodename: dv-osbrick-853789-1-iscsi Aug 22 20:24:53.512170 dv-osbrick-853789-1-iscsi devstack@keystone.service[81626]: machine: x86_64 Aug 22 20:24:53.512170 dv-osbrick-853789-1-iscsi devstack@keystone.service[81626]: clock source: unix Aug 22 20:24:53.512170 dv-osbrick-853789-1-iscsi devstack@keystone.service[81626]: pcre jit disabled Aug 22 20:24:53.512170 dv-osbrick-853789-1-iscsi devstack@keystone.service[81626]: detected number of CPU cores: 4 Aug 22 20:24:53.512170 dv-osbrick-853789-1-iscsi devstack@keystone.service[81626]: current working directory: / Aug 22 20:24:53.512170 dv-osbrick-853789-1-iscsi devstack@keystone.service[81626]: detected binary path: /usr/bin/uwsgi-core Aug 22 20:24:53.512761 dv-osbrick-853789-1-iscsi devstack@keystone.service[81626]: your processes number limit is 47680 Aug 22 20:24:53.512761 dv-osbrick-853789-1-iscsi devstack@keystone.service[81626]: your memory page size is 4096 bytes Aug 22 20:24:53.512761 dv-osbrick-853789-1-iscsi devstack@keystone.service[81626]: detected max file descriptor number: 2048 Aug 22 20:24:53.512761 dv-osbrick-853789-1-iscsi devstack@keystone.service[81626]: lock engine: pthread robust mutexes Aug 22 20:24:53.512761 dv-osbrick-853789-1-iscsi devstack@keystone.service[81626]: thunder lock: enabled Aug 22 20:24:53.512761 dv-osbrick-853789-1-iscsi devstack@keystone.service[81626]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 22 20:24:53.512761 dv-osbrick-853789-1-iscsi devstack@keystone.service[81626]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 22 20:24:53.554331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81626]: Python main interpreter initialized at 0x55e7b28559c0 Aug 22 20:24:53.554331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81626]: python threads support enabled Aug 22 20:24:53.554331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81626]: your server socket listen backlog is limited to 100 connections Aug 22 20:24:53.554331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81626]: your mercy for graceful operations on workers is 90 seconds Aug 22 20:24:53.554819 dv-osbrick-853789-1-iscsi devstack@keystone.service[81626]: mapped 403077 bytes (393 KB) for 2 cores Aug 22 20:24:53.555038 dv-osbrick-853789-1-iscsi devstack@keystone.service[81626]: *** Operational MODE: preforking *** Aug 22 20:24:53.555240 dv-osbrick-853789-1-iscsi devstack@keystone.service[81626]: *** uWSGI is running in multiple interpreter mode *** Aug 22 20:24:53.555240 dv-osbrick-853789-1-iscsi devstack@keystone.service[81626]: spawned uWSGI master process (pid: 81626) Aug 22 20:24:53.555440 dv-osbrick-853789-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 22 20:24:53.556408 dv-osbrick-853789-1-iscsi devstack@keystone.service[81626]: spawned uWSGI worker 1 (pid: 81637, cores: 1) Aug 22 20:24:53.556408 dv-osbrick-853789-1-iscsi devstack@keystone.service[81626]: spawned uWSGI worker 2 (pid: 81638, cores: 1) Aug 22 20:24:53.557414 dv-osbrick-853789-1-iscsi devstack@keystone.service[81626]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 22 20:24:57.924602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 20:24:57.924602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: from cryptography.utils import int_from_bytes Aug 22 20:24:57.925437 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 20:24:57.925437 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: from cryptography.utils import int_from_bytes Aug 22 20:24:57.935279 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 20:24:57.935279 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: from cryptography.utils import int_from_bytes Aug 22 20:24:57.935768 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 20:24:57.935768 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: from cryptography.utils import int_from_bytes Aug 22 20:24:57.984137 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 20:24:57.984340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 20:24:57.984497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] command line args: [] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 20:24:57.984784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 20:24:57.984959 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ================================================================================ {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 20:24:57.985209 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] admin_token = **** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.985451 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] config_dir = [] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.985638 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.985818 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] config_source = [] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.985995 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] debug = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.986190 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.986554 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.986731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.986980 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.987223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.987451 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] list_limit = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.987627 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] log_config_append = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.987803 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.987978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] log_dir = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.988152 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] log_file = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.988383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.988626 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.988902 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.989107 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 20:24:57.989206 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.989287 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 20:24:57.989434 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.989516 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.989632 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] command line args: [] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 20:24:57.989762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.989869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 20:24:57.989954 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.990077 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ================================================================================ {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 20:24:57.990181 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.990307 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] admin_token = **** {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.990390 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.990554 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] config_dir = [] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.990632 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.990749 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.990823 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.990947 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] config_source = [] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.991028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.991100 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] debug = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.991240 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.991325 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.991486 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.992071 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.992259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.992514 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.62/identity {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.992608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.992714 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] publish_errors = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.993043 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.993129 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.993287 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] list_limit = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.993414 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.993499 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] log_config_append = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.993624 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.993737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.993818 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.993938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] log_dir = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.994014 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.994135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] log_file = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.994223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] standard_threads = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.994343 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.994423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.994542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.994616 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.994736 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.994811 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.994924 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.995006 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] use_journal = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.995125 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.995201 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] use_json = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.995321 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.995402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] use_stderr = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.995402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] use_syslog = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.995524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.995619 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.995747 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.995873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:57.995950 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.996110 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:57.996194 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.996366 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:57.996449 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.996601 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:57.996696 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.996878 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:57.996956 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.997113 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:57.997191 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.997358 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:57.997441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.997591 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:57.997834 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:57.997924 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.62/identity {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.998040 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] publish_errors = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.998119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:57.998275 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.998360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:57.998511 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.998588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:57.998694 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.998777 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:57.998943 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.999095 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:57.999174 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.999245 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:57.999402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] standard_threads = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.999541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:57.999624 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.999695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:57.999869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:57.999953 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.000048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:58.000131 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.000213 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] use_journal = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:58.000352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.000428 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] use_json = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:58.000550 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] use_stderr = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:58.000625 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.000752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] use_syslog = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:58.000842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.000987 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 20:24:58.001095 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.001248 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.001338 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.001487 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.001579 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.001748 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.001832 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.001988 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.002065 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.002217 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.002349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.002455 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.002539 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.002700 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.002777 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.002938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.003026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.003160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.003236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.003388 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.003465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.003631 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.003716 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.003874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.003950 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.004108 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.004185 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.004340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.004490 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.004565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.004633 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.004807 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.004886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.005037 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.005126 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.005265 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.005343 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.005491 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.005569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.005717 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.005804 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.005943 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.006020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.006175 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.006256 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.006418 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.006505 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.006645 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.006721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.006877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.006953 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.007104 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.007298 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.008085 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.008194 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.008332 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.008552 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.008737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.008838 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.008953 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.009027 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.009183 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.009305 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.009388 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.009502 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.009583 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.009696 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.009770 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.009917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.010007 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.010151 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.010268 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.010397 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.010474 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.010630 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.010722 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.010882 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.011020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.011104 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.011179 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.011338 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.011419 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.011570 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.011655 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.011799 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.011878 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.012029 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.012106 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.012258 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.012346 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.012496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.012892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.012892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.013033 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.013095 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.013169 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.013309 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.013478 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.013603 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.013687 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.013761 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.013887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.013966 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.014037 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.014178 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.014258 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.014415 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.014501 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.014650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.014729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.014891 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.014968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.015128 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.015233 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.015360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.015449 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.015591 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.015668 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.015821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.015900 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.016051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.016129 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.016293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.016370 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.016529 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.016608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.016787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.016876 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.017026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.017103 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.017252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.017339 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.017484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.017567 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.017716 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.017792 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.017948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.018033 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.018173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.018250 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.018402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.018482 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.018630 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.018708 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.018863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.018942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.019090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.019168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.019327 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.019405 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.019560 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.019646 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.019805 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.019887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.020042 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.020121 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.020294 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.020374 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.020535 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.020612 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.020795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.020874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.021025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] auth.external = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.021104 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.021253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.021332 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.021487 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.021563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.021725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.021803 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.021975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] auth.password = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.022051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.022203 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] auth.token = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.022286 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.022442 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.022521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.022673 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.022749 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.022951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.023049 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.023178 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.023394 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.023473 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.023653 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.023729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.023881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.023966 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.024115 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] credential.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.024199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.024359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.024436 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.024594 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.024704 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.024858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.024946 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.025091 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.025168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.025333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.025410 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.025561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.025646 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.025807 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.025932 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.026045 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.026124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.026276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.026362 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.026541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.026629 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.026782 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.026863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.027016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] auth.external = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.027103 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.027248 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.027335 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.027515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.027593 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.027763 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.027841 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.027994 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] federation.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.028070 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] auth.password = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.028222 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] auth.token = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.028304 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.028461 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.028541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.028720 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.028804 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.031102 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.031208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.031295 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.031359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.031429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.031499 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.031570 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.031640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.031718 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.031797 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.031797 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] credential.caching = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.031926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.031926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.032053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.032203 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.032278 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.032349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.032419 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.032489 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.032564 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.032644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.032781 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.032858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.032929 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.033000 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.033083 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.033167 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.033240 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.033312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.033382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.033453 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.033523 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.033601 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.033601 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.033730 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.033806 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.033879 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.033949 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.034027 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.034099 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.034169 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.034240 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.034310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.034380 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.034458 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] federation.caching = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.034531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.034602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.034673 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.034743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.034813 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.034897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.034971 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.035041 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.035111 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.035181 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.035288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.035375 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.035517 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.035596 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.035752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.035894 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.036033 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.036163 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.036286 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.036413 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.036540 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.036723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.036857 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.036984 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] identity.caching = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.037110 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.037233 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.037356 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.037478 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.037614 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.037743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.037867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.037996 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.038133 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.038255 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.038389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.038562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.038689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.038816 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.038941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.038941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.039187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.039312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.039312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.039546 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.039677 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.039800 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.039885 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.039966 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.040039 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.040110 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.040181 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.040252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.040330 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.040403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.040509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.040588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.040839 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.040920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.041070 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.041151 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.041314 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.041393 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.041557 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.041636 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.041789 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.041869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.042021 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.042098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.042251 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.042328 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.042479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.042595 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.042714 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.042793 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.042957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.043081 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.043200 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.043313 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.043493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.043578 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.043685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.043790 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.043934 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.044034 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.044181 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.044259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.044418 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.044497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.044709 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.044793 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.044937 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.045019 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.045166 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.045243 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.045395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.045476 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.045623 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.045700 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.045862 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.045940 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.046099 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.046179 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.046339 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.046416 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.046573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.046652 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.046822 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.046941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.047079 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.047209 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.047334 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.047412 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.047566 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.047645 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.047799 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.047924 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.048026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.048104 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.048266 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.048345 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.048510 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.048590 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.048765 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.048846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.049002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.049082 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.049235 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.049314 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.049472 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.049557 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.049703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.049782 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.049933 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.050011 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.050170 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.050256 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.050413 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.050490 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.050649 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.050726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.050876 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.050962 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.051105 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.051177 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.051340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] resource.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.051417 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.051571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.051656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.051814 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.051919 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.052047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.052155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.052290 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.052407 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.052536 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.052694 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.052777 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.052927 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.053005 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.058601 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.058725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.058851 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.058932 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.059004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.059087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] role.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.059170 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.059244 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] role.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.059314 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.059385 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.059385 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.059513 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.059592 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.059665 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.059738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.059808 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.059886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.059948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.060026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.060026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.060152 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.060223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.060293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.060363 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.060442 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.060515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.060592 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.060708 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.060784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.060856 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.060939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.061013 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.061085 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.061156 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.061227 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.061227 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.061363 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.061436 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.061508 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.061578 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.061649 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.061721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.061800 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.061873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] resource.caching = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.061945 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.062015 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.062086 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.062157 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.062236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.062310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.062381 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.062451 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.062518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.062585 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.062657 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.062728 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.062798 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.062869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.062940 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.062940 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.063077 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.063148 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.063220 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.063290 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.063290 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.063423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] role.caching = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.063496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.063496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.063623 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] role.driver = sql {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.063693 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.063693 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] token.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.063827 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.063900 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.063900 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.064026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.064098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.064098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.064241 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.064346 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.064346 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.064453 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.064511 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.064511 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.064647 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.064738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.064738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.064929 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.065011 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.065159 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.065402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.065484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.065647 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.065878 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.065956 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.066115 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.066360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.066441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.066645 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.connection = **** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.066818 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.066908 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.067113 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.067291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.067377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.067569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.067780 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.067858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.068017 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.068249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.068334 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.068481 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.068642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.068772 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.068963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.069083 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.069205 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.069334 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.069437 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.069598 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.070298 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.070462 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.070625 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.070875 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.070957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.071285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.071375 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.071532 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.071626 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.071771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.071851 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.071943 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 20:24:58.072023 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.072270 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.072511 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.072776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.073017 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.073275 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.073536 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.073788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.074029 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.074267 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.074500 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.074739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] token.caching = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.074980 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.075229 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.075544 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.075773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.076019 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.076260 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.076506 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.076786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.077038 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.077276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.077516 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.077752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.077997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.078244 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.078475 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.078718 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.079019 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.079280 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] database.connection = **** {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.079527 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.079774 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.080012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.080253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.080490 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.080751 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.080990 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.081226 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.081470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.081707 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.081953 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.082190 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.082441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.082676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.082922 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.083157 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.083398 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.083635 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 20:24:58.083806 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 20:24:58.101654 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.101882 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.102110 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.110427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.114636 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.114870 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.115097 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.124216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.138943 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.139171 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.143287 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.143617 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.203399 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.209184 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.254646 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.254875 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.256576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.256833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.421521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.421752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.422024 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.422191 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.422407 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.422572 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.422661 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.422809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.423033 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.423254 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.423473 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.423691 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.451851 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.452022 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.452112 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.452258 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.452344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.452490 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.452576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.452743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.453060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.453060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.453513 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.453513 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.453893 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.453893 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.465436 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.466355 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.480573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.480817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.480951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.481108 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.481238 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.481363 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.481487 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.481615 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.481696 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.481772 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.481844 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.481917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81638) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.482035 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.482253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81637) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 20:24:58.498877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.499087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 20:24:58.499431 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.499514 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.499633 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 20:24:58.499730 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 20:24:58.499910 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.500040 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.500172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.500253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 20:24:58.500507 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.500703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.500811 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.500976 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.501077 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.501338 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.510328 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.510606 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.510877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.511171 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.511390 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.511677 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.520009 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.520009 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.520148 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:24:58.520218 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:24:58.521003 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:24:58.521291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.521575 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.521856 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.522140 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.522222 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:24:58.522402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.522514 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.522672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.522874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.523002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.523351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.523453 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.523773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.523857 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.524047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.524268 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.524349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.524703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.524946 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.525228 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.525505 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.547710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.549278 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:24:58.549368 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.549564 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.550931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:24:58.551217 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.554345 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:24:58.554656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.554994 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.556286 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:24:58.556574 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.556889 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.561370 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:24:58.561655 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.563444 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:24:58.563736 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.565766 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:24:58.566058 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.566343 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.566626 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.566903 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.567182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.567450 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.567716 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.567879 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:24:58.568177 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.568468 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.568783 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.569067 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.569349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.570144 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.570588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.586793 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.587074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.589494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.589775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.590971 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:24:58.593672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:24:58.594212 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.594512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.597011 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.597310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.598720 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:24:58.601944 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:24:58.602127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:24:58.605134 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:24:58.605395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.605700 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.605984 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.606266 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.606541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.606820 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.608408 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.608733 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.609024 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.609316 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.609592 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.609887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.622871 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:24:58.623156 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.623457 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.623730 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.626379 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:24:58.626668 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.626941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.627207 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.630628 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.632716 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.633150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.635039 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.635810 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:24:58.636099 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.636370 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.636621 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.636776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.636911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.637042 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.639569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:24:58.639856 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.640156 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.640452 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.640761 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.648912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:24:58.651970 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.651970 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.651970 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.651970 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.651970 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.651970 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.653136 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:24:58.653423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.653707 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.653990 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.654274 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.654553 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.654833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.665955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:24:58.668987 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:24:58.670861 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:24:58.671956 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.673368 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.673960 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:24:58.674844 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:24:58.675128 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.675419 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.676894 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.678337 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.680180 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:24:58.680467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.680797 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.681961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.683406 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:24:58.686296 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.686592 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.686885 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.687169 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.692190 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.692190 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:24:58.692190 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.692190 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.692439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.692551 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.695830 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:24:58.696222 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.696505 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.701491 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:24:58.701785 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.702073 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.703496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81638) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:24:58.703720 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.704004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.704284 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.704558 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.704859 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.705137 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.705416 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.705704 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.705980 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.706251 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.706514 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.706791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.707060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81638) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.709451 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81637) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 20:24:58.709738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.710034 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.710973 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.711479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.711838 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.712127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.712403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.712711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.712992 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.713287 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.713563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.713834 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.714100 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81637) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 20:24:58.742492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e7b28559c0 pid: 81638 (default app) Aug 22 20:24:58.745917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289efce8-3a1f-4c7c-9193-c8b9ae769f66 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:24:58.746201 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289efce8-3a1f-4c7c-9193-c8b9ae769f66 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:24:58.746467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289efce8-3a1f-4c7c-9193-c8b9ae769f66 None None] PATH_INFO: `/v3` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:24:58.749325 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e7b28559c0 pid: 81637 (default app) Aug 22 20:24:58.750565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 1/1] 10.222.0.62 () {50 vars in 791 bytes} [Mon Aug 22 20:24:58 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:06.205543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53b09b-865e-4b9e-8f55-880663cf3293 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:06.206057 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53b09b-865e-4b9e-8f55-880663cf3293 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:06.206057 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53b09b-865e-4b9e-8f55-880663cf3293 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:06.210616 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 1/2] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:25:06.217811 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c613953-b409-4c34-ac6d-bdc002ad85d4 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:06.218237 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c613953-b409-4c34-ac6d-bdc002ad85d4 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:06.218353 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c613953-b409-4c34-ac6d-bdc002ad85d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:06.287459 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: INFO dbcounter [None req-2c613953-b409-4c34-ac6d-bdc002ad85d4 None None] Registered counter for database keystone Aug 22 20:25:06.309026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG oslo_db.sqlalchemy.engines [None req-2c613953-b409-4c34-ac6d-bdc002ad85d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 20:25:06.315362 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writer thread running {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 20:25:06.491964 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG passlib.handlers.bcrypt [None req-2c613953-b409-4c34-ac6d-bdc002ad85d4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81638) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 22 20:25:06.492308 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG passlib.handlers.bcrypt [None req-2c613953-b409-4c34-ac6d-bdc002ad85d4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81638) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 22 20:25:06.546527 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-2c613953-b409-4c34-ac6d-bdc002ad85d4 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:06.548102 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2c613953-b409-4c34-ac6d-bdc002ad85d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:06.677605 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 2/3] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 22 20:25:07.147059 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53b09b-865e-4b9e-8f55-880663cf3293 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:07.215005 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: INFO dbcounter [None req-5d53b09b-865e-4b9e-8f55-880663cf3293 None None] Registered counter for database keystone Aug 22 20:25:07.233873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG oslo_db.sqlalchemy.engines [None req-5d53b09b-865e-4b9e-8f55-880663cf3293 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 20:25:07.239989 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writer thread running {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 20:25:07.359146 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53b09b-865e-4b9e-8f55-880663cf3293 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:07.363327 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17d411-5aa2-417d-a2c9-1295f1c214ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:07.363951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17d411-5aa2-417d-a2c9-1295f1c214ef admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:07.364228 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17d411-5aa2-417d-a2c9-1295f1c214ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:07.364496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17d411-5aa2-417d-a2c9-1295f1c214ef admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:07.372996 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c17d411-5aa2-417d-a2c9-1295f1c214ef admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:07.425360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3c17d411-5aa2-417d-a2c9-1295f1c214ef admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 22 20:25:07.425645 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c17d411-5aa2-417d-a2c9-1295f1c214ef admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:07.435548 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 2/4] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Aug 22 20:25:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 20:25:07.441575 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c613953-b409-4c34-ac6d-bdc002ad85d4 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:07.455969 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c613953-b409-4c34-ac6d-bdc002ad85d4 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:07.460540 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693aef81-8365-4716-a6df-50fec31707ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:07.461658 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693aef81-8365-4716-a6df-50fec31707ef admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:07.461940 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693aef81-8365-4716-a6df-50fec31707ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:07.462206 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693aef81-8365-4716-a6df-50fec31707ef admin admin] PATH_INFO: `/v3/projects/7adb0f361d1a498f9e39b33b2bbe63ec` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:07.463742 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693aef81-8365-4716-a6df-50fec31707ef admin admin] RBAC: Authorizing `identity:get_project(project_id=7adb0f361d1a498f9e39b33b2bbe63ec)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:07.517688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: WARNING keystone.common.rbac_enforcer.enforcer [None req-693aef81-8365-4716-a6df-50fec31707ef admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 22 20:25:07.518022 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693aef81-8365-4716-a6df-50fec31707ef admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:07.522464 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 3/5] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Aug 22 20:25:07 2022] GET /identity/v3/projects/7adb0f361d1a498f9e39b33b2bbe63ec => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:25:09.398389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15c3b8-020a-4301-a810-33607880a04d None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:09.398936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15c3b8-020a-4301-a810-33607880a04d None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:09.398936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15c3b8-020a-4301-a810-33607880a04d None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:09.403711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 3/6] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:09.409190 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cdc70-ac87-46ff-b09f-0bdeecc5e17b None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:09.409613 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cdc70-ac87-46ff-b09f-0bdeecc5e17b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:09.409720 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cdc70-ac87-46ff-b09f-0bdeecc5e17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:09.429936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-2d5cdc70-ac87-46ff-b09f-0bdeecc5e17b None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:09.431436 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2d5cdc70-ac87-46ff-b09f-0bdeecc5e17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:09.439694 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 4/7] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 22 20:25:09.705968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15c3b8-020a-4301-a810-33607880a04d None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:09.718975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15c3b8-020a-4301-a810-33607880a04d None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:09.723239 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79c86b-fd50-4351-9921-a86927a1826d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:09.723829 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79c86b-fd50-4351-9921-a86927a1826d admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:09.724104 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79c86b-fd50-4351-9921-a86927a1826d admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:09.724370 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79c86b-fd50-4351-9921-a86927a1826d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:09.731946 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a79c86b-fd50-4351-9921-a86927a1826d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:09.733766 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a79c86b-fd50-4351-9921-a86927a1826d admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:09.742442 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 4/8] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Aug 22 20:25:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 20:25:09.748086 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5cdc70-ac87-46ff-b09f-0bdeecc5e17b None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:09.757225 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5cdc70-ac87-46ff-b09f-0bdeecc5e17b None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:09.762338 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965d2dc-d9cd-4727-9665-79d431b2301c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:09.762957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965d2dc-d9cd-4727-9665-79d431b2301c admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:09.763237 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965d2dc-d9cd-4727-9665-79d431b2301c admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:09.763512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965d2dc-d9cd-4727-9665-79d431b2301c admin admin] PATH_INFO: `/v3/users/1d89af55e2b04afa9fa5ae15b3027c4e` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:09.764839 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965d2dc-d9cd-4727-9665-79d431b2301c admin admin] RBAC: Authorizing `identity:get_user(user_id=1d89af55e2b04afa9fa5ae15b3027c4e)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:09.766678 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965d2dc-d9cd-4727-9665-79d431b2301c admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:09.768180 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 5/9] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Aug 22 20:25:09 2022] GET /identity/v3/users/1d89af55e2b04afa9fa5ae15b3027c4e => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:11.754738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59211425-8b78-49ea-8189-022b92d816c4 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:11.755364 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59211425-8b78-49ea-8189-022b92d816c4 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:11.755364 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59211425-8b78-49ea-8189-022b92d816c4 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:11.756577 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 5/10] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:11.762376 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535aa512-0cfa-402f-8c32-c9d66a84272f None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:11.762790 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535aa512-0cfa-402f-8c32-c9d66a84272f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:11.763066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535aa512-0cfa-402f-8c32-c9d66a84272f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:11.781564 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-535aa512-0cfa-402f-8c32-c9d66a84272f None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:11.782751 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-535aa512-0cfa-402f-8c32-c9d66a84272f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:11.821433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca91c62-00c5-427a-9d67-eb28b9e69d46 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:11.821718 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca91c62-00c5-427a-9d67-eb28b9e69d46 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:11.822484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca91c62-00c5-427a-9d67-eb28b9e69d46 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:11.823904 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 6/11] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:25:11.829214 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb8ea2-70c9-4203-b3e5-456fa1d640ee None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:11.829497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb8ea2-70c9-4203-b3e5-456fa1d640ee None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:11.829771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb8ea2-70c9-4203-b3e5-456fa1d640ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:11.866087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 6/12] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:25:11.872181 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG passlib.handlers.bcrypt [None req-bfcb8ea2-70c9-4203-b3e5-456fa1d640ee None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81637) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 22 20:25:11.872603 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG passlib.handlers.bcrypt [None req-bfcb8ea2-70c9-4203-b3e5-456fa1d640ee None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81637) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 22 20:25:11.918851 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-bfcb8ea2-70c9-4203-b3e5-456fa1d640ee None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:11.920424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-bfcb8ea2-70c9-4203-b3e5-456fa1d640ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:12.017272 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 7/13] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:25:12.139209 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535aa512-0cfa-402f-8c32-c9d66a84272f None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:12.163271 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:12.247193 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535aa512-0cfa-402f-8c32-c9d66a84272f None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:12.280057 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1957cf-736f-4c4f-ba95-1d2f0394009d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:12.280712 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1957cf-736f-4c4f-ba95-1d2f0394009d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:12.280991 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1957cf-736f-4c4f-ba95-1d2f0394009d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:12.281263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1957cf-736f-4c4f-ba95-1d2f0394009d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:12.282830 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb8ea2-70c9-4203-b3e5-456fa1d640ee None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:12.293023 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1957cf-736f-4c4f-ba95-1d2f0394009d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:25:12.301479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-fc1957cf-736f-4c4f-ba95-1d2f0394009d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:25:12.301479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:25:12.301479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:25:12.301479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:25:12.301479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:25:12.301479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:25:12.301479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:25:12.301479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:25:12.301479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:25:12.301479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:25:12.301479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:25:12.301479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:25:12.301479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:25:12.301479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:25:12.301479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:25:12.301479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:25:12.302504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:25:12.302504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:25:12.302504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:25:12.302504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:25:12.302504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:25:12.302504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:25:12.302504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:25:12.302504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:25:12.302504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:25:12.302504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:25:12.302504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:25:12.302504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:25:12.302504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:25:12.302504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:25:12.302504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:25:12.302504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:25:12.303346 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:25:12.303346 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:25:12.303346 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:25:12.303346 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:25:12.303346 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:25:12.303346 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:25:12.303346 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:25:12.303346 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:25:12.303346 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:25:12.303346 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:25:12.303346 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:25:12.303346 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:25:12.303346 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 7/14] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 22 20:25:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:25:12.308916 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1957cf-736f-4c4f-ba95-1d2f0394009d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:12.387533 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb8ea2-70c9-4203-b3e5-456fa1d640ee None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:12.389819 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:12.391887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:12.410575 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1957cf-736f-4c4f-ba95-1d2f0394009d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:12.424455 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d22e4-0d84-44e4-922c-a61f8ff3e2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:12.425360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d22e4-0d84-44e4-922c-a61f8ff3e2c9 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:12.425643 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d22e4-0d84-44e4-922c-a61f8ff3e2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:12.425916 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d22e4-0d84-44e4-922c-a61f8ff3e2c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:12.445358 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15736645-0693-4fd0-8aff-83455601dbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:12.445956 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15736645-0693-4fd0-8aff-83455601dbe6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:12.446315 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15736645-0693-4fd0-8aff-83455601dbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:12.446673 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15736645-0693-4fd0-8aff-83455601dbe6 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:12.447378 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15736645-0693-4fd0-8aff-83455601dbe6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:12.447867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15736645-0693-4fd0-8aff-83455601dbe6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:12.449410 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15736645-0693-4fd0-8aff-83455601dbe6 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:12.463070 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 8/15] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:25:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:25:12.468496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15736645-0693-4fd0-8aff-83455601dbe6 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:12.495388 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d22e4-0d84-44e4-922c-a61f8ff3e2c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:12.496936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d22e4-0d84-44e4-922c-a61f8ff3e2c9 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:12.568537 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15736645-0693-4fd0-8aff-83455601dbe6 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:12.594548 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 8/16] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:25:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 20:25:12.600134 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d22e4-0d84-44e4-922c-a61f8ff3e2c9 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:12.602805 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:12.604321 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8d6c2-e929-447d-b5b5-ffb9b6ce41ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:12.605164 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8d6c2-e929-447d-b5b5-ffb9b6ce41ce None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:12.611733 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8d6c2-e929-447d-b5b5-ffb9b6ce41ce None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:12.611733 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8d6c2-e929-447d-b5b5-ffb9b6ce41ce None admin] PATH_INFO: `/v3/users/1d89af55e2b04afa9fa5ae15b3027c4e` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:12.611733 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8d6c2-e929-447d-b5b5-ffb9b6ce41ce None admin] RBAC: Authorizing `identity:get_user(user_id=1d89af55e2b04afa9fa5ae15b3027c4e)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:12.611733 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8d6c2-e929-447d-b5b5-ffb9b6ce41ce None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:12.611733 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 9/17] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:25:12 2022] GET /identity/v3/users/1d89af55e2b04afa9fa5ae15b3027c4e => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:25:12.615496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8d6c2-e929-447d-b5b5-ffb9b6ce41ce None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:12.630096 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:12.699423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d22e4-0d84-44e4-922c-a61f8ff3e2c9 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:12.715413 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8d6c2-e929-447d-b5b5-ffb9b6ce41ce None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:12.733111 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434aa948-2d11-4972-9bce-0d0ffcf47f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:12.733969 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434aa948-2d11-4972-9bce-0d0ffcf47f94 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:12.734244 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434aa948-2d11-4972-9bce-0d0ffcf47f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:12.734511 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434aa948-2d11-4972-9bce-0d0ffcf47f94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:12.750570 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b23bc-7e01-427f-a75d-66b442ca2335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:12.751197 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b23bc-7e01-427f-a75d-66b442ca2335 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:12.751473 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b23bc-7e01-427f-a75d-66b442ca2335 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:12.751741 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b23bc-7e01-427f-a75d-66b442ca2335 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:12.752886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b23bc-7e01-427f-a75d-66b442ca2335 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:12.754310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434aa948-2d11-4972-9bce-0d0ffcf47f94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:12.754428 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b23bc-7e01-427f-a75d-66b442ca2335 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:12.755791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434aa948-2d11-4972-9bce-0d0ffcf47f94 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:12.756315 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 10/18] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:25:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:25:12.762578 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b23bc-7e01-427f-a75d-66b442ca2335 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:12.774756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-434aa948-2d11-4972-9bce-0d0ffcf47f94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:25:12.774756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:25:12.774756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:25:12.774756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:25:12.774756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:25:12.774756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:25:12.774756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:25:12.774756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:25:12.774756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:25:12.774756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:25:12.774756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:25:12.774756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:25:12.774756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:25:12.774756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:25:12.774756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:25:12.774756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:25:12.775854 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:25:12.775854 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:25:12.775854 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:25:12.775854 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:25:12.775854 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:25:12.775854 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:25:12.775854 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:25:12.775854 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:25:12.775854 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:25:12.775854 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:25:12.775854 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:25:12.775854 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:25:12.775854 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:25:12.775854 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:25:12.775854 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:25:12.775854 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:25:12.775854 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:25:12.777082 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:25:12.777082 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:25:12.777082 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:25:12.777082 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 9/19] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:25:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:25:12.781520 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434aa948-2d11-4972-9bce-0d0ffcf47f94 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:12.841301 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:12.845594 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:12.865294 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b23bc-7e01-427f-a75d-66b442ca2335 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:12.886995 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434aa948-2d11-4972-9bce-0d0ffcf47f94 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:12.900940 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f31ff-d28c-498c-80eb-6bd6574c7e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:12.901663 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f31ff-d28c-498c-80eb-6bd6574c7e7e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:12.901947 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f31ff-d28c-498c-80eb-6bd6574c7e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:12.902224 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f31ff-d28c-498c-80eb-6bd6574c7e7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:12.902953 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f31ff-d28c-498c-80eb-6bd6574c7e7e None admin] RBAC: Adding query filter params (role.id=e3faa0474c054da6bb4d8910a4e40bff, scope.domain.id=default, user.id=1d89af55e2b04afa9fa5ae15b3027c4e) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:12.903324 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f31ff-d28c-498c-80eb-6bd6574c7e7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:12.904809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f31ff-d28c-498c-80eb-6bd6574c7e7e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:12.912146 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 11/20] 10.222.0.62 () {56 vars in 1322 bytes} [Mon Aug 22 20:25:12 2022] GET /identity/v3/role_assignments?user.id=1d89af55e2b04afa9fa5ae15b3027c4e&scope.domain.id=default&role.id=e3faa0474c054da6bb4d8910a4e40bff => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:25:12.922601 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e69f9-12dd-4ef5-8c6d-fd493dcc7aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:12.923236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e69f9-12dd-4ef5-8c6d-fd493dcc7aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:12.923519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e69f9-12dd-4ef5-8c6d-fd493dcc7aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:12.923793 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e69f9-12dd-4ef5-8c6d-fd493dcc7aa1 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:12.924461 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e69f9-12dd-4ef5-8c6d-fd493dcc7aa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:12.924828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e69f9-12dd-4ef5-8c6d-fd493dcc7aa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:12.926279 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e69f9-12dd-4ef5-8c6d-fd493dcc7aa1 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:12.946109 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 10/21] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:25:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:25:14.974844 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915836ac-c60f-4216-b1f2-a825f444c2f5 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:14.975881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915836ac-c60f-4216-b1f2-a825f444c2f5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:14.976373 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915836ac-c60f-4216-b1f2-a825f444c2f5 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:14.978132 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 12/22] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:14.983646 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184a84c-6533-4b4e-8569-d9b140ae8000 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:14.984519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184a84c-6533-4b4e-8569-d9b140ae8000 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:14.985006 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184a84c-6533-4b4e-8569-d9b140ae8000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:15.008729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-5184a84c-6533-4b4e-8569-d9b140ae8000 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:15.011520 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-5184a84c-6533-4b4e-8569-d9b140ae8000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:15.099116 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 11/23] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:25:15.395228 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89a03d-849e-4158-ba3d-0d93fb32dc5f None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:15.395880 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89a03d-849e-4158-ba3d-0d93fb32dc5f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:15.396359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89a03d-849e-4158-ba3d-0d93fb32dc5f None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:15.397905 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 13/24] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:15.412356 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb5cb6-1cb2-4ee3-914d-d0c8bc669a14 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:15.412968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb5cb6-1cb2-4ee3-914d-d0c8bc669a14 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:15.413484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb5cb6-1cb2-4ee3-914d-d0c8bc669a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:15.441992 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-dbdb5cb6-1cb2-4ee3-914d-d0c8bc669a14 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:15.443559 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-dbdb5cb6-1cb2-4ee3-914d-d0c8bc669a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:15.505287 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:15.537959 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 12/25] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:25:15.563592 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d89544-344f-4476-b0ea-0311cfb93732 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:15.563872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d89544-344f-4476-b0ea-0311cfb93732 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:15.564157 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d89544-344f-4476-b0ea-0311cfb93732 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:15.565513 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 14/26] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:15.570875 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e928f-b27f-4a15-a1dc-08bf451945b7 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:15.571173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e928f-b27f-4a15-a1dc-08bf451945b7 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:15.571451 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e928f-b27f-4a15-a1dc-08bf451945b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:15.597160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-9b9e928f-b27f-4a15-a1dc-08bf451945b7 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:15.598371 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-9b9e928f-b27f-4a15-a1dc-08bf451945b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:15.621818 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307e94e-cb15-4adc-b349-11f1f79f99b6 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:15.622108 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307e94e-cb15-4adc-b349-11f1f79f99b6 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:15.622377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307e94e-cb15-4adc-b349-11f1f79f99b6 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:15.623977 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 15/27] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:15.629168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491ada8-8d8c-484e-8793-bb8cc30fd64d None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:15.629449 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491ada8-8d8c-484e-8793-bb8cc30fd64d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:15.629727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491ada8-8d8c-484e-8793-bb8cc30fd64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:15.660012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-5491ada8-8d8c-484e-8793-bb8cc30fd64d None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:15.661191 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5491ada8-8d8c-484e-8793-bb8cc30fd64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:15.741938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 13/28] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:25:15.742577 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e928f-b27f-4a15-a1dc-08bf451945b7 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:15.778291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 16/29] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:25:15.905278 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e928f-b27f-4a15-a1dc-08bf451945b7 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:15.913056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:15.951482 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad40ce-d288-4698-8df3-4af4ca5c2f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:15.952127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad40ce-d288-4698-8df3-4af4ca5c2f79 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:15.952464 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad40ce-d288-4698-8df3-4af4ca5c2f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:15.952771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad40ce-d288-4698-8df3-4af4ca5c2f79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:15.956106 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491ada8-8d8c-484e-8793-bb8cc30fd64d None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:15.995928 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad40ce-d288-4698-8df3-4af4ca5c2f79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:25:16.010985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-65ad40ce-d288-4698-8df3-4af4ca5c2f79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:25:16.010985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:25:16.010985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:25:16.010985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:25:16.010985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:25:16.010985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:25:16.010985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:25:16.010985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:25:16.010985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:25:16.010985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:25:16.010985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:25:16.010985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:25:16.010985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:25:16.010985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:25:16.010985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:25:16.010985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:25:16.011820 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:25:16.011820 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:25:16.011820 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:25:16.011820 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:25:16.011820 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:25:16.011820 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:25:16.011820 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:25:16.011820 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:25:16.011820 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:25:16.011820 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:25:16.011820 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:25:16.011820 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:25:16.011820 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:25:16.011820 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:25:16.011820 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:25:16.011820 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:25:16.012640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:25:16.012640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:25:16.012640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:25:16.012640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:25:16.012640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:25:16.012640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:25:16.012640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:25:16.012640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:25:16.012640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:25:16.012640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:25:16.012640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:25:16.012640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:25:16.018350 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 14/30] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 22 20:25:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:25:16.019269 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad40ce-d288-4698-8df3-4af4ca5c2f79 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:16.097027 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:16.146611 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491ada8-8d8c-484e-8793-bb8cc30fd64d None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:16.190233 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25ca8a-a280-4416-b7f7-7a081acbf995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:16.191031 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad40ce-d288-4698-8df3-4af4ca5c2f79 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:16.191279 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25ca8a-a280-4416-b7f7-7a081acbf995 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:16.191655 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25ca8a-a280-4416-b7f7-7a081acbf995 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:16.192026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25ca8a-a280-4416-b7f7-7a081acbf995 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:16.192822 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25ca8a-a280-4416-b7f7-7a081acbf995 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:16.195508 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25ca8a-a280-4416-b7f7-7a081acbf995 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:16.228684 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e9647-e41a-4faa-8491-51f4c078d5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:16.229310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e9647-e41a-4faa-8491-51f4c078d5bf None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:16.229591 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e9647-e41a-4faa-8491-51f4c078d5bf None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:16.229866 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e9647-e41a-4faa-8491-51f4c078d5bf None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:16.230528 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6e9647-e41a-4faa-8491-51f4c078d5bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:16.230831 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6e9647-e41a-4faa-8491-51f4c078d5bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:16.232759 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6e9647-e41a-4faa-8491-51f4c078d5bf None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:16.245398 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 15/31] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:25:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:16.245945 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e9647-e41a-4faa-8491-51f4c078d5bf None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:16.276726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:16.361469 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e9647-e41a-4faa-8491-51f4c078d5bf None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:16.398766 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53628ba4-6e21-40e3-86b6-8c62df8eccca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:16.399880 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53628ba4-6e21-40e3-86b6-8c62df8eccca None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:16.400354 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53628ba4-6e21-40e3-86b6-8c62df8eccca None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:16.400850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53628ba4-6e21-40e3-86b6-8c62df8eccca None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:16.401757 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53628ba4-6e21-40e3-86b6-8c62df8eccca None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:16.403357 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53628ba4-6e21-40e3-86b6-8c62df8eccca None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:16.424814 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 17/32] 10.222.0.62 () {60 vars in 1131 bytes} [Mon Aug 22 20:25:15 2022] POST /identity/v3/roles => generated 219 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:25:16.430036 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25ca8a-a280-4416-b7f7-7a081acbf995 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:16.620237 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25ca8a-a280-4416-b7f7-7a081acbf995 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:16.645960 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 16/33] 10.222.0.62 () {60 vars in 1131 bytes} [Mon Aug 22 20:25:16 2022] POST /identity/v3/roles => generated 225 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:25:16.647042 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53628ba4-6e21-40e3-86b6-8c62df8eccca None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:16.679283 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470e001-a85c-4aae-9c90-63365543a540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:16.680360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470e001-a85c-4aae-9c90-63365543a540 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:16.680866 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470e001-a85c-4aae-9c90-63365543a540 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:16.681874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470e001-a85c-4aae-9c90-63365543a540 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:16.693057 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:16.701875 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470e001-a85c-4aae-9c90-63365543a540 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:16.703586 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470e001-a85c-4aae-9c90-63365543a540 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:16.728978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-1470e001-a85c-4aae-9c90-63365543a540 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:25:16.728978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:25:16.728978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:25:16.728978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:25:16.728978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:25:16.728978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:25:16.728978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:25:16.728978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:25:16.728978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:25:16.728978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:25:16.728978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:25:16.728978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:25:16.728978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:25:16.728978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:25:16.728978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:25:16.728978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:25:16.730075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:25:16.730075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:25:16.730075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:25:16.730075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:25:16.730075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:25:16.730075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:25:16.730075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:25:16.730075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:25:16.730075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:25:16.730075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:25:16.730075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:25:16.730075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:25:16.730075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:25:16.730075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:25:16.730075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:25:16.730075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:25:16.730075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:25:16.730853 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:25:16.730853 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:25:16.730853 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:25:16.730853 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 18/34] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:25:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:25:16.738685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470e001-a85c-4aae-9c90-63365543a540 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:16.758059 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:16.773043 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53628ba4-6e21-40e3-86b6-8c62df8eccca None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:16.816897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21c667-e177-42e4-b767-aa238af82fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:16.821760 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21c667-e177-42e4-b767-aa238af82fca None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:16.822301 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21c667-e177-42e4-b767-aa238af82fca None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:16.822753 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21c667-e177-42e4-b767-aa238af82fca None admin] PATH_INFO: `/v3/users/1d89af55e2b04afa9fa5ae15b3027c4e` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:16.824776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21c667-e177-42e4-b767-aa238af82fca None admin] RBAC: Authorizing `identity:get_user(user_id=1d89af55e2b04afa9fa5ae15b3027c4e)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:16.827575 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21c667-e177-42e4-b767-aa238af82fca None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:16.829762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 17/35] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:25:16 2022] GET /identity/v3/users/1d89af55e2b04afa9fa5ae15b3027c4e => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:16.836239 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21c667-e177-42e4-b767-aa238af82fca None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:16.934114 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470e001-a85c-4aae-9c90-63365543a540 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:16.975209 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e79761-f49d-450e-a9ca-8ca43dfd365e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:16.975927 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e79761-f49d-450e-a9ca-8ca43dfd365e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:16.976767 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e79761-f49d-450e-a9ca-8ca43dfd365e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:16.977048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e79761-f49d-450e-a9ca-8ca43dfd365e None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:16.978203 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e79761-f49d-450e-a9ca-8ca43dfd365e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:16.978572 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e79761-f49d-450e-a9ca-8ca43dfd365e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:16.979978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e79761-f49d-450e-a9ca-8ca43dfd365e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:17.000647 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21c667-e177-42e4-b767-aa238af82fca None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:17.007954 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 19/36] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:25:17.010306 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678d059-2a37-47c7-aee0-451d9bbd6070 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:17.010596 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678d059-2a37-47c7-aee0-451d9bbd6070 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:17.010925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678d059-2a37-47c7-aee0-451d9bbd6070 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:17.012363 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 20/37] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:17.012966 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678d059-2a37-47c7-aee0-451d9bbd6070 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:17.042120 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee0183-f917-406b-a556-adae57c19683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:17.042879 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee0183-f917-406b-a556-adae57c19683 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:17.043104 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee0183-f917-406b-a556-adae57c19683 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:17.043367 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee0183-f917-406b-a556-adae57c19683 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:17.044621 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee0183-f917-406b-a556-adae57c19683 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:17.046158 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee0183-f917-406b-a556-adae57c19683 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:17.047706 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 18/38] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:25:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:25:17.052595 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8a007-5071-4351-b100-d234ed096874 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:17.052595 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8a007-5071-4351-b100-d234ed096874 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:17.052595 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8a007-5071-4351-b100-d234ed096874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:17.068417 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-9cf8a007-5071-4351-b100-d234ed096874 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:17.069955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-9cf8a007-5071-4351-b100-d234ed096874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:17.071413 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:17.087375 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:17.126682 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678d059-2a37-47c7-aee0-451d9bbd6070 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:17.136325 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 19/39] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:25:17.137256 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8a007-5071-4351-b100-d234ed096874 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:17.174930 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023fedb-fbdc-466d-ab15-01d2c5cb3d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:17.175147 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023fedb-fbdc-466d-ab15-01d2c5cb3d92 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:17.175380 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023fedb-fbdc-466d-ab15-01d2c5cb3d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:17.175651 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023fedb-fbdc-466d-ab15-01d2c5cb3d92 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:17.176291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a023fedb-fbdc-466d-ab15-01d2c5cb3d92 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:17.177774 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a023fedb-fbdc-466d-ab15-01d2c5cb3d92 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:17.242427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8a007-5071-4351-b100-d234ed096874 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:17.277582 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f142c2-4505-4b47-a718-6336e2bca56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:17.278192 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f142c2-4505-4b47-a718-6336e2bca56e None admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:17.278476 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f142c2-4505-4b47-a718-6336e2bca56e None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:17.278755 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f142c2-4505-4b47-a718-6336e2bca56e None admin] PATH_INFO: `/v3/domains/default/users/1d89af55e2b04afa9fa5ae15b3027c4e/roles/e3faa0474c054da6bb4d8910a4e40bff` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:17.280721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f142c2-4505-4b47-a718-6336e2bca56e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1d89af55e2b04afa9fa5ae15b3027c4e, role_id=e3faa0474c054da6bb4d8910a4e40bff)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:17.282170 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f142c2-4505-4b47-a718-6336e2bca56e None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:17.298632 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 21/40] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Aug 22 20:25:17 2022] POST /identity/v3/projects => generated 301 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:25:17.299868 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777aef9c-18c7-46b7-99ba-0eb908efaa1c None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:17.300159 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777aef9c-18c7-46b7-99ba-0eb908efaa1c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:17.300439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777aef9c-18c7-46b7-99ba-0eb908efaa1c None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:17.301905 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 22/41] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:17.308792 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab7397-fa16-47a5-9378-57365a5fcc35 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:17.309092 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab7397-fa16-47a5-9378-57365a5fcc35 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:17.309348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab7397-fa16-47a5-9378-57365a5fcc35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:17.329763 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-73ab7397-fa16-47a5-9378-57365a5fcc35 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:17.331340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-73ab7397-fa16-47a5-9378-57365a5fcc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:17.354127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 20/42] 10.222.0.62 () {58 vars in 1361 bytes} [Mon Aug 22 20:25:17 2022] PUT /identity/v3/domains/default/users/1d89af55e2b04afa9fa5ae15b3027c4e/roles/e3faa0474c054da6bb4d8910a4e40bff => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:25:17.406035 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f142c2-4505-4b47-a718-6336e2bca56e None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:17.432084 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 23/43] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:25:17.435061 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:17.531232 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f142c2-4505-4b47-a718-6336e2bca56e None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:17.569356 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d932c36-c746-4d11-b2d3-81394afc4117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:17.575877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d932c36-c746-4d11-b2d3-81394afc4117 None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:17.575877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d932c36-c746-4d11-b2d3-81394afc4117 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:17.575877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d932c36-c746-4d11-b2d3-81394afc4117 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:17.575877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d932c36-c746-4d11-b2d3-81394afc4117 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:17.575877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d932c36-c746-4d11-b2d3-81394afc4117 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:17.705575 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab7397-fa16-47a5-9378-57365a5fcc35 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:17.706308 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 21/44] 10.222.0.62 () {60 vars in 1131 bytes} [Mon Aug 22 20:25:17 2022] POST /identity/v3/roles => generated 223 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:25:17.741326 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:17.834413 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab7397-fa16-47a5-9378-57365a5fcc35 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:17.873839 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb01115-80c4-411f-9a2e-aed6ff43aed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:17.874492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb01115-80c4-411f-9a2e-aed6ff43aed6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:17.874775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb01115-80c4-411f-9a2e-aed6ff43aed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:17.875100 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb01115-80c4-411f-9a2e-aed6ff43aed6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:17.876163 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb01115-80c4-411f-9a2e-aed6ff43aed6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:17.877671 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb01115-80c4-411f-9a2e-aed6ff43aed6 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:17.879398 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 24/45] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:25:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:25:17.885643 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d932c36-c746-4d11-b2d3-81394afc4117 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:18.064194 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:18.088334 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d932c36-c746-4d11-b2d3-81394afc4117 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:18.121304 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88337cbf-9b73-4d46-b30e-9fc343dab1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:18.121985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88337cbf-9b73-4d46-b30e-9fc343dab1bf None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:18.122261 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88337cbf-9b73-4d46-b30e-9fc343dab1bf None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:18.122541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88337cbf-9b73-4d46-b30e-9fc343dab1bf None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:18.123198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88337cbf-9b73-4d46-b30e-9fc343dab1bf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:18.124680 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88337cbf-9b73-4d46-b30e-9fc343dab1bf None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:18.202533 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 22/46] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Aug 22 20:25:17 2022] POST /identity/v3/projects => generated 312 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:25:19.316441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302807b2-5820-4811-b556-235d84eaf4a2 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:19.317002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302807b2-5820-4811-b556-235d84eaf4a2 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:19.317105 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302807b2-5820-4811-b556-235d84eaf4a2 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:19.318397 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 25/47] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:19.324144 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf0e96-6237-43ad-bdee-8e22491bfd21 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:19.324562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf0e96-6237-43ad-bdee-8e22491bfd21 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:19.324732 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf0e96-6237-43ad-bdee-8e22491bfd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:19.342955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-eabf0e96-6237-43ad-bdee-8e22491bfd21 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:19.344163 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-eabf0e96-6237-43ad-bdee-8e22491bfd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:19.409559 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 23/48] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:25:19.682159 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302807b2-5820-4811-b556-235d84eaf4a2 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:19.783923 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:19.791030 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302807b2-5820-4811-b556-235d84eaf4a2 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:19.825374 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b01ff9-1dda-4283-950e-82d4940084ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:19.826008 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b01ff9-1dda-4283-950e-82d4940084ee None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:19.826292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b01ff9-1dda-4283-950e-82d4940084ee None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:19.826566 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b01ff9-1dda-4283-950e-82d4940084ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:19.836950 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b01ff9-1dda-4283-950e-82d4940084ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:25:19.842216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-27b01ff9-1dda-4283-950e-82d4940084ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:25:19.842216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:25:19.842216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:25:19.842216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:25:19.842216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:25:19.842216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:25:19.842216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:25:19.842216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:25:19.842216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:25:19.842216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:25:19.842216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:25:19.842216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:25:19.842216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:25:19.842216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:25:19.842216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:25:19.842216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:25:19.843011 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:25:19.843011 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:25:19.843011 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:25:19.843011 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:25:19.843011 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:25:19.843011 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:25:19.843011 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:25:19.843011 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:25:19.843011 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:25:19.843011 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:25:19.843011 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:25:19.843011 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:25:19.843011 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:25:19.843011 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:25:19.843011 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:25:19.843011 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:25:19.843737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:25:19.843737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:25:19.843737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:25:19.843737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:25:19.843737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:25:19.843737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:25:19.843737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:25:19.843737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:25:19.843737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:25:19.843737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:25:19.843737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:25:19.843737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:25:19.843737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 26/49] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 22 20:25:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:25:19.849068 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf0e96-6237-43ad-bdee-8e22491bfd21 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:19.904435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:19.949066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf0e96-6237-43ad-bdee-8e22491bfd21 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:19.982245 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e70ede-5bf5-486a-afeb-e01729a68b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:19.982854 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e70ede-5bf5-486a-afeb-e01729a68b84 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:19.983136 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e70ede-5bf5-486a-afeb-e01729a68b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:19.983406 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e70ede-5bf5-486a-afeb-e01729a68b84 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:19.984068 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e70ede-5bf5-486a-afeb-e01729a68b84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:19.984368 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e70ede-5bf5-486a-afeb-e01729a68b84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:19.985768 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e70ede-5bf5-486a-afeb-e01729a68b84 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:19.994328 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 24/50] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:25:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:19.999962 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b01ff9-1dda-4283-950e-82d4940084ee None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:20.148375 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee636522-3845-40fd-97fd-abbb1f27ff73 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:20.148685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee636522-3845-40fd-97fd-abbb1f27ff73 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:20.149094 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee636522-3845-40fd-97fd-abbb1f27ff73 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:20.151330 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 25/51] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:25:20.156464 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b6796-8859-43ac-b2cc-ba6682ceac03 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:20.156789 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b6796-8859-43ac-b2cc-ba6682ceac03 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:20.157073 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b6796-8859-43ac-b2cc-ba6682ceac03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:20.175323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-b68b6796-8859-43ac-b2cc-ba6682ceac03 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:20.176513 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b68b6796-8859-43ac-b2cc-ba6682ceac03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:20.207873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b01ff9-1dda-4283-950e-82d4940084ee None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:20.242258 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 26/52] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:25:20.242530 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed48bc-155f-4ef7-9d48-ebaf677700fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:20.243072 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed48bc-155f-4ef7-9d48-ebaf677700fd None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:20.243470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed48bc-155f-4ef7-9d48-ebaf677700fd None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:20.243748 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed48bc-155f-4ef7-9d48-ebaf677700fd None admin] PATH_INFO: `/v3/users/1d89af55e2b04afa9fa5ae15b3027c4e` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:20.245107 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed48bc-155f-4ef7-9d48-ebaf677700fd None admin] RBAC: Authorizing `identity:get_user(user_id=1d89af55e2b04afa9fa5ae15b3027c4e)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:20.246564 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed48bc-155f-4ef7-9d48-ebaf677700fd None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:20.248292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 27/53] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:25:19 2022] GET /identity/v3/users/1d89af55e2b04afa9fa5ae15b3027c4e => generated 247 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:20.253646 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b6796-8859-43ac-b2cc-ba6682ceac03 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:20.302017 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:20.351974 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b6796-8859-43ac-b2cc-ba6682ceac03 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:20.384796 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2e8bc-e180-4829-a507-fbc7c564eee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:20.385462 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2e8bc-e180-4829-a507-fbc7c564eee0 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:20.385749 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2e8bc-e180-4829-a507-fbc7c564eee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:20.386027 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2e8bc-e180-4829-a507-fbc7c564eee0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:20.387155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2e8bc-e180-4829-a507-fbc7c564eee0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:20.388616 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2e8bc-e180-4829-a507-fbc7c564eee0 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:20.390198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 27/54] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:25:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:20.395992 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed48bc-155f-4ef7-9d48-ebaf677700fd None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:20.421914 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:20.496394 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed48bc-155f-4ef7-9d48-ebaf677700fd None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:20.510925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2e8bc-e180-4829-a507-fbc7c564eee0 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:20.530441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f00ed-9f37-495f-8f80-f851527671f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:20.531045 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f00ed-9f37-495f-8f80-f851527671f8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:20.531329 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f00ed-9f37-495f-8f80-f851527671f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:20.531603 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f00ed-9f37-495f-8f80-f851527671f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:20.532324 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f00ed-9f37-495f-8f80-f851527671f8 None admin] RBAC: Adding query filter params (role.id=e3faa0474c054da6bb4d8910a4e40bff, scope.domain.id=default, user.id=1d89af55e2b04afa9fa5ae15b3027c4e) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:20.532636 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f00ed-9f37-495f-8f80-f851527671f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:20.534117 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f00ed-9f37-495f-8f80-f851527671f8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:20.539745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 28/55] 10.222.0.62 () {56 vars in 1322 bytes} [Mon Aug 22 20:25:20 2022] GET /identity/v3/role_assignments?user.id=1d89af55e2b04afa9fa5ae15b3027c4e&scope.domain.id=default&role.id=e3faa0474c054da6bb4d8910a4e40bff => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:20.616115 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2e8bc-e180-4829-a507-fbc7c564eee0 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:20.635469 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:20.653851 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af74ec-aec4-4983-b283-1d6a6fd105e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:20.654522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af74ec-aec4-4983-b283-1d6a6fd105e7 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:20.654810 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af74ec-aec4-4983-b283-1d6a6fd105e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:20.655108 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af74ec-aec4-4983-b283-1d6a6fd105e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:20.656244 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af74ec-aec4-4983-b283-1d6a6fd105e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:20.657853 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af74ec-aec4-4983-b283-1d6a6fd105e7 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:20.659636 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 28/56] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:25:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:25:20.665391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f00ed-9f37-495f-8f80-f851527671f8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:20.765819 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:20.778517 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f00ed-9f37-495f-8f80-f851527671f8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:20.817796 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e6a88-d9b2-488d-9f07-73be8125ec96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:20.818410 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e6a88-d9b2-488d-9f07-73be8125ec96 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:20.818696 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e6a88-d9b2-488d-9f07-73be8125ec96 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:20.818973 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e6a88-d9b2-488d-9f07-73be8125ec96 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:20.819637 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e6a88-d9b2-488d-9f07-73be8125ec96 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:20.821152 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e6a88-d9b2-488d-9f07-73be8125ec96 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:20.888403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 29/57] 10.222.0.62 () {60 vars in 1140 bytes} [Mon Aug 22 20:25:20 2022] POST /identity/v3/projects => generated 298 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:25:22.782117 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e1343-d33c-4ec1-aebb-2f34610d93cd None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:22.782643 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e1343-d33c-4ec1-aebb-2f34610d93cd None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:22.782643 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e1343-d33c-4ec1-aebb-2f34610d93cd None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:22.783987 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 29/58] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:22.789340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3e6c6-81eb-4b50-be22-5fb700a3e48f None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:22.789752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3e6c6-81eb-4b50-be22-5fb700a3e48f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:22.789927 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3e6c6-81eb-4b50-be22-5fb700a3e48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:22.808366 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-8ae3e6c6-81eb-4b50-be22-5fb700a3e48f None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:22.809599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8ae3e6c6-81eb-4b50-be22-5fb700a3e48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:22.874347 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 30/59] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:25:23.142650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e1343-d33c-4ec1-aebb-2f34610d93cd None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:23.244373 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e1343-d33c-4ec1-aebb-2f34610d93cd None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:23.278075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633939ac-8f8a-46a9-8b7f-9fd8a852ae01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:23.278697 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633939ac-8f8a-46a9-8b7f-9fd8a852ae01 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:23.278981 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633939ac-8f8a-46a9-8b7f-9fd8a852ae01 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:23.279257 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633939ac-8f8a-46a9-8b7f-9fd8a852ae01 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:23.280369 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633939ac-8f8a-46a9-8b7f-9fd8a852ae01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:23.281834 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633939ac-8f8a-46a9-8b7f-9fd8a852ae01 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:23.283377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 30/60] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:25:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:23.289015 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3e6c6-81eb-4b50-be22-5fb700a3e48f None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:23.359800 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:23.391015 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3e6c6-81eb-4b50-be22-5fb700a3e48f None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:23.424703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17594b25-5e8f-4193-a4c0-45e2e5459790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:23.425264 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17594b25-5e8f-4193-a4c0-45e2e5459790 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:23.425974 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17594b25-5e8f-4193-a4c0-45e2e5459790 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:23.426254 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17594b25-5e8f-4193-a4c0-45e2e5459790 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:23.426897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17594b25-5e8f-4193-a4c0-45e2e5459790 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:23.428356 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17594b25-5e8f-4193-a4c0-45e2e5459790 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:23.552133 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 31/61] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Aug 22 20:25:23 2022] POST /identity/v3/users => generated 275 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:25:26.429798 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a456716-245c-4456-8fa5-a1f0a3eaa2c0 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:26.429798 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a456716-245c-4456-8fa5-a1f0a3eaa2c0 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:26.429798 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a456716-245c-4456-8fa5-a1f0a3eaa2c0 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:26.430902 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 31/62] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:26.435718 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1453b-0333-483d-9473-517375ee4970 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:26.436565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1453b-0333-483d-9473-517375ee4970 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:26.437089 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1453b-0333-483d-9473-517375ee4970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:26.464526 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-77e1453b-0333-483d-9473-517375ee4970 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:26.466132 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-77e1453b-0333-483d-9473-517375ee4970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:26.565359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 32/63] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:25:26.684548 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec8fcb-22ea-4967-81cf-d96b5b289fd7 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:26.685167 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec8fcb-22ea-4967-81cf-d96b5b289fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:26.685644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec8fcb-22ea-4967-81cf-d96b5b289fd7 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:26.687532 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 32/64] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:26.692892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221197a-67e3-4821-a8ae-72f7d0d94232 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:26.693411 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221197a-67e3-4821-a8ae-72f7d0d94232 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:26.693882 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0221197a-67e3-4821-a8ae-72f7d0d94232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:26.721681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-0221197a-67e3-4821-a8ae-72f7d0d94232 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:26.723253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0221197a-67e3-4821-a8ae-72f7d0d94232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:26.797672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:26.822881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 33/65] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:25:27.000153 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec8fcb-22ea-4967-81cf-d96b5b289fd7 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:27.074161 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:27.145373 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec8fcb-22ea-4967-81cf-d96b5b289fd7 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:27.156871 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12316e5-bd5d-4332-b3f4-39900ef82a3a None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:27.157366 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12316e5-bd5d-4332-b3f4-39900ef82a3a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:27.157782 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12316e5-bd5d-4332-b3f4-39900ef82a3a None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:27.159282 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 34/66] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:27.178264 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff2a46-3ebe-4701-b477-5df170558d92 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:27.178750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff2a46-3ebe-4701-b477-5df170558d92 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:27.179166 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff2a46-3ebe-4701-b477-5df170558d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:27.193382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd6a51-175c-4783-b096-bb1e67a15403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:27.198763 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd6a51-175c-4783-b096-bb1e67a15403 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:27.199053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd6a51-175c-4783-b096-bb1e67a15403 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:27.199340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd6a51-175c-4783-b096-bb1e67a15403 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:27.205694 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-f2ff2a46-3ebe-4701-b477-5df170558d92 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:27.207585 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f2ff2a46-3ebe-4701-b477-5df170558d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:27.212330 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd6a51-175c-4783-b096-bb1e67a15403 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:25:27.218976 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-18cd6a51-175c-4783-b096-bb1e67a15403 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:25:27.218976 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:25:27.218976 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:25:27.218976 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:25:27.218976 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:25:27.218976 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:25:27.218976 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:25:27.218976 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:25:27.218976 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:25:27.218976 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:25:27.218976 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:25:27.218976 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:25:27.218976 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:25:27.218976 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:25:27.218976 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:25:27.218976 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:25:27.220040 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:25:27.220040 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:25:27.220040 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:25:27.220040 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:25:27.220040 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:25:27.220040 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:25:27.220040 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:25:27.220040 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:25:27.220040 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:25:27.220040 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:25:27.220040 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:25:27.220040 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:25:27.220040 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:25:27.220040 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:25:27.220040 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:25:27.220040 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:25:27.221028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:25:27.221028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:25:27.221028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:25:27.221028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:25:27.221028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:25:27.221028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:25:27.221028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:25:27.221028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:25:27.221028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:25:27.221028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:25:27.221028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:25:27.221028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:25:27.228361 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 33/67] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:25:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:25:27.228361 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd6a51-175c-4783-b096-bb1e67a15403 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:27.290924 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 35/68] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:25:27.292723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff2a46-3ebe-4701-b477-5df170558d92 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:27.356017 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd6a51-175c-4783-b096-bb1e67a15403 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:27.369549 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:27.391846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc33af8a-56ed-48a1-b87e-051565d015b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:27.392607 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33af8a-56ed-48a1-b87e-051565d015b4 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:27.392936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33af8a-56ed-48a1-b87e-051565d015b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:27.393207 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc33af8a-56ed-48a1-b87e-051565d015b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:27.400454 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff2a46-3ebe-4701-b477-5df170558d92 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:27.403556 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc33af8a-56ed-48a1-b87e-051565d015b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:25:27.408681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-bc33af8a-56ed-48a1-b87e-051565d015b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:25:27.408681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:25:27.408681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:25:27.408681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:25:27.408681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:25:27.408681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:25:27.408681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:25:27.408681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:25:27.408681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:25:27.408681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:25:27.408681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:25:27.408681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:25:27.408681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:25:27.408681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:25:27.408681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:25:27.408681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:25:27.409541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:25:27.409541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:25:27.409541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:25:27.409541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:25:27.409541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:25:27.409541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:25:27.409541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:25:27.409541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:25:27.409541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:25:27.409541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:25:27.409541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:25:27.409541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:25:27.409541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:25:27.409541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:25:27.409541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:25:27.409541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:25:27.410286 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:25:27.410286 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:25:27.410286 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:25:27.410286 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:25:27.410286 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:25:27.410286 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:25:27.410286 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:25:27.410286 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:25:27.410286 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:25:27.410286 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:25:27.410286 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:25:27.410286 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:25:27.410286 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 34/69] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 22 20:25:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:25:27.410903 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04eff66-1c86-45e4-ab22-fa264c880297 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:27.412081 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04eff66-1c86-45e4-ab22-fa264c880297 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:27.412081 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04eff66-1c86-45e4-ab22-fa264c880297 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:27.416196 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 35/70] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:27.418326 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c3e51-acf1-4cfd-8ccf-aacf77770918 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:27.418620 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c3e51-acf1-4cfd-8ccf-aacf77770918 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:27.419053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c3e51-acf1-4cfd-8ccf-aacf77770918 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:27.420318 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 36/71] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:27.421618 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c3e51-acf1-4cfd-8ccf-aacf77770918 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:27.428675 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:27.448307 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29219ca0-d4ec-42a2-adeb-6db640260e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:27.449040 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29219ca0-d4ec-42a2-adeb-6db640260e80 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:27.449299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29219ca0-d4ec-42a2-adeb-6db640260e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:27.449581 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29219ca0-d4ec-42a2-adeb-6db640260e80 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:27.450247 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29219ca0-d4ec-42a2-adeb-6db640260e80 None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:27.450561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29219ca0-d4ec-42a2-adeb-6db640260e80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:27.451976 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29219ca0-d4ec-42a2-adeb-6db640260e80 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:27.465468 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 36/72] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 22 20:25:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:27.466604 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf89ca-f5b5-46b9-a40c-13cd11cc2799 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:27.467036 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf89ca-f5b5-46b9-a40c-13cd11cc2799 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:27.467391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf89ca-f5b5-46b9-a40c-13cd11cc2799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:27.486916 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-76bf89ca-f5b5-46b9-a40c-13cd11cc2799 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:27.488311 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-76bf89ca-f5b5-46b9-a40c-13cd11cc2799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:27.538349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c3e51-acf1-4cfd-8ccf-aacf77770918 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:27.558043 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 37/73] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:25:27.568908 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b09598-aeee-46df-a911-bc5ecc58ba79 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:27.568908 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b09598-aeee-46df-a911-bc5ecc58ba79 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:27.568908 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b09598-aeee-46df-a911-bc5ecc58ba79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:27.578202 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-f8b09598-aeee-46df-a911-bc5ecc58ba79 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:27.579399 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f8b09598-aeee-46df-a911-bc5ecc58ba79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:27.587140 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c41c5e-59be-41e9-b1a0-3e1fe91f6062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:27.588577 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c41c5e-59be-41e9-b1a0-3e1fe91f6062 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:27.588911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c41c5e-59be-41e9-b1a0-3e1fe91f6062 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:27.589200 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c41c5e-59be-41e9-b1a0-3e1fe91f6062 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:27.590343 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c41c5e-59be-41e9-b1a0-3e1fe91f6062 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:27.590658 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c41c5e-59be-41e9-b1a0-3e1fe91f6062 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:27.592850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c41c5e-59be-41e9-b1a0-3e1fe91f6062 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:27.609254 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 37/74] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:25:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:27.609254 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c41c5e-59be-41e9-b1a0-3e1fe91f6062 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:27.645638 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:27.660870 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 38/75] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:25:27.660870 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b09598-aeee-46df-a911-bc5ecc58ba79 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:27.717232 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:27.718448 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c41c5e-59be-41e9-b1a0-3e1fe91f6062 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:27.754350 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03ff39-8ecf-419a-b244-90041e5151ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:27.755076 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03ff39-8ecf-419a-b244-90041e5151ea None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:27.755439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03ff39-8ecf-419a-b244-90041e5151ea None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:27.755781 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03ff39-8ecf-419a-b244-90041e5151ea None admin] PATH_INFO: `/v3/users/380073b53b464cf9968503ff9be682ba` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:27.772284 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03ff39-8ecf-419a-b244-90041e5151ea None admin] RBAC: Authorizing `identity:get_user(user_id=380073b53b464cf9968503ff9be682ba)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:27.774013 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03ff39-8ecf-419a-b244-90041e5151ea None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:27.776138 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 38/76] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:25:27 2022] GET /identity/v3/users/380073b53b464cf9968503ff9be682ba => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:27.777078 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03ff39-8ecf-419a-b244-90041e5151ea None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:27.792165 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b09598-aeee-46df-a911-bc5ecc58ba79 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:27.831396 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f769d-113d-4e83-9d84-85adeafdd95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:27.832779 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f769d-113d-4e83-9d84-85adeafdd95c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:27.833151 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f769d-113d-4e83-9d84-85adeafdd95c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:27.833484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f769d-113d-4e83-9d84-85adeafdd95c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:27.846968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f769d-113d-4e83-9d84-85adeafdd95c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:25:27.851835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-269f769d-113d-4e83-9d84-85adeafdd95c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:25:27.851835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:25:27.851835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:25:27.851835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:25:27.851835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:25:27.851835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:25:27.851835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:25:27.851835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:25:27.851835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:25:27.851835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:25:27.851835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:25:27.851835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:25:27.851835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:25:27.851835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:25:27.851835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:25:27.851835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:25:27.852683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:25:27.852683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:25:27.852683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:25:27.852683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:25:27.852683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:25:27.852683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:25:27.852683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:25:27.852683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:25:27.852683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:25:27.852683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:25:27.852683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:25:27.852683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:25:27.852683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:25:27.852683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:25:27.852683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:25:27.852683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:25:27.853972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:25:27.853972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:25:27.853972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:25:27.853972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:25:27.853972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:25:27.853972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:25:27.853972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:25:27.853972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:25:27.853972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:25:27.853972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:25:27.853972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:25:27.853972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:25:27.853972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 39/77] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:25:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:25:27.854684 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f769d-113d-4e83-9d84-85adeafdd95c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:27.897872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:27.907765 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03ff39-8ecf-419a-b244-90041e5151ea None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:27.944745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bbe78-48ae-4f53-b736-0cd7bcd97dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:27.945394 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bbe78-48ae-4f53-b736-0cd7bcd97dfc None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:27.945687 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bbe78-48ae-4f53-b736-0cd7bcd97dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:27.945967 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bbe78-48ae-4f53-b736-0cd7bcd97dfc None admin] PATH_INFO: `/v3/users/1d89af55e2b04afa9fa5ae15b3027c4e` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:27.947156 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9bbe78-48ae-4f53-b736-0cd7bcd97dfc None admin] RBAC: Authorizing `identity:get_user(user_id=1d89af55e2b04afa9fa5ae15b3027c4e)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:27.948617 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9bbe78-48ae-4f53-b736-0cd7bcd97dfc None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:27.954688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 39/78] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:25:27 2022] GET /identity/v3/users/1d89af55e2b04afa9fa5ae15b3027c4e => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:27.954688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bbe78-48ae-4f53-b736-0cd7bcd97dfc None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:27.958242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:27.962208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f769d-113d-4e83-9d84-85adeafdd95c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:27.997773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3e2b1-15e5-4dd9-9b66-60cec4ea10e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:27.998388 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3e2b1-15e5-4dd9-9b66-60cec4ea10e2 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:27.998670 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3e2b1-15e5-4dd9-9b66-60cec4ea10e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:27.998948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3e2b1-15e5-4dd9-9b66-60cec4ea10e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:28.049927 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bbe78-48ae-4f53-b736-0cd7bcd97dfc None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:28.065659 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd3e2b1-15e5-4dd9-9b66-60cec4ea10e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:28.067144 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd3e2b1-15e5-4dd9-9b66-60cec4ea10e2 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:28.084517 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b675047-7afe-4ca6-8074-59825d247022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:28.085111 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b675047-7afe-4ca6-8074-59825d247022 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:28.085392 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b675047-7afe-4ca6-8074-59825d247022 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:28.085664 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b675047-7afe-4ca6-8074-59825d247022 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:28.096161 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b675047-7afe-4ca6-8074-59825d247022 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:25:28.100840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-4b675047-7afe-4ca6-8074-59825d247022 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:25:28.100840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:25:28.100840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:25:28.100840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:25:28.100840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:25:28.100840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:25:28.100840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:25:28.100840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:25:28.100840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:25:28.100840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:25:28.100840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:25:28.100840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:25:28.100840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:25:28.100840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:25:28.100840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:25:28.100840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:25:28.101676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:25:28.101676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:25:28.101676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:25:28.101676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:25:28.101676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:25:28.101676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:25:28.101676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:25:28.101676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:25:28.101676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:25:28.101676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:25:28.101676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:25:28.101676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:25:28.101676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:25:28.101676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:25:28.101676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:25:28.101676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:25:28.102725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:25:28.102725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:25:28.102725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:25:28.102725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:25:28.102725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:25:28.102725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:25:28.102725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:25:28.102725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:25:28.102725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:25:28.102725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:25:28.102725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:25:28.102725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:25:28.102725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 40/79] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 22 20:25:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:25:28.102725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b675047-7afe-4ca6-8074-59825d247022 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:28.127064 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:28.167880 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:28.172283 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 40/80] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:25:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:25:28.177552 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3e2b1-15e5-4dd9-9b66-60cec4ea10e2 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:28.205556 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b675047-7afe-4ca6-8074-59825d247022 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:28.239992 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3770887-da42-49cd-9e32-b06dba177ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:28.240715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3770887-da42-49cd-9e32-b06dba177ef7 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:28.240997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3770887-da42-49cd-9e32-b06dba177ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:28.241273 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3770887-da42-49cd-9e32-b06dba177ef7 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:28.241942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3770887-da42-49cd-9e32-b06dba177ef7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:28.242255 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3770887-da42-49cd-9e32-b06dba177ef7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:28.244324 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3770887-da42-49cd-9e32-b06dba177ef7 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:28.252497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 41/81] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 22 20:25:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:28.253332 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3770887-da42-49cd-9e32-b06dba177ef7 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:28.279739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3e2b1-15e5-4dd9-9b66-60cec4ea10e2 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:28.313738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd337df-9691-4e50-b10f-d42f422d0ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:28.314370 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd337df-9691-4e50-b10f-d42f422d0ea1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:28.314653 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd337df-9691-4e50-b10f-d42f422d0ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:28.314934 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd337df-9691-4e50-b10f-d42f422d0ea1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:28.316059 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd337df-9691-4e50-b10f-d42f422d0ea1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:28.317562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd337df-9691-4e50-b10f-d42f422d0ea1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:28.319126 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 41/82] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:25:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:28.319882 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd337df-9691-4e50-b10f-d42f422d0ea1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:28.335036 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:28.352595 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3770887-da42-49cd-9e32-b06dba177ef7 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:28.386023 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:28.386995 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b147fe-0019-40d5-9d37-9c9dd314f958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:28.387598 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b147fe-0019-40d5-9d37-9c9dd314f958 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:28.387939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b147fe-0019-40d5-9d37-9c9dd314f958 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:28.388214 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b147fe-0019-40d5-9d37-9c9dd314f958 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:28.419999 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd337df-9691-4e50-b10f-d42f422d0ea1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:28.453756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37aa763-e6a7-4a5d-b600-10987ca5845d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:28.454352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37aa763-e6a7-4a5d-b600-10987ca5845d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:28.454437 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b147fe-0019-40d5-9d37-9c9dd314f958 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:28.454623 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37aa763-e6a7-4a5d-b600-10987ca5845d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:28.454894 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37aa763-e6a7-4a5d-b600-10987ca5845d None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:28.455551 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37aa763-e6a7-4a5d-b600-10987ca5845d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:28.455818 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b147fe-0019-40d5-9d37-9c9dd314f958 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:28.455900 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37aa763-e6a7-4a5d-b600-10987ca5845d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:28.457494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37aa763-e6a7-4a5d-b600-10987ca5845d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:28.465273 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 42/83] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:25:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:28.466778 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37aa763-e6a7-4a5d-b600-10987ca5845d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:28.535086 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:28.553889 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 42/84] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:25:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:25:28.554711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b147fe-0019-40d5-9d37-9c9dd314f958 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:28.570650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37aa763-e6a7-4a5d-b600-10987ca5845d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:28.597894 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:28.605520 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3f4f9-6822-4c30-bd1b-18576b22ae9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:28.606150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3f4f9-6822-4c30-bd1b-18576b22ae9d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:28.606469 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3f4f9-6822-4c30-bd1b-18576b22ae9d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:28.606743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3f4f9-6822-4c30-bd1b-18576b22ae9d None admin] PATH_INFO: `/v3/projects/3883b1b257924533a84cbc24a92ea6e1` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:28.607860 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3f4f9-6822-4c30-bd1b-18576b22ae9d None admin] RBAC: Authorizing `identity:get_project(project_id=3883b1b257924533a84cbc24a92ea6e1)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:28.609342 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3f4f9-6822-4c30-bd1b-18576b22ae9d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:28.610990 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 43/85] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:25:28 2022] GET /identity/v3/projects/3883b1b257924533a84cbc24a92ea6e1 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:28.611808 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3f4f9-6822-4c30-bd1b-18576b22ae9d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:28.658009 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b147fe-0019-40d5-9d37-9c9dd314f958 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:28.693483 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3627d7-1b86-4a28-86f1-ac2398336184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:28.694115 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3627d7-1b86-4a28-86f1-ac2398336184 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:28.694398 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3627d7-1b86-4a28-86f1-ac2398336184 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:28.694674 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3627d7-1b86-4a28-86f1-ac2398336184 None admin] PATH_INFO: `/v3/users/380073b53b464cf9968503ff9be682ba` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:28.695792 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3627d7-1b86-4a28-86f1-ac2398336184 None admin] RBAC: Authorizing `identity:get_user(user_id=380073b53b464cf9968503ff9be682ba)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:28.697938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3627d7-1b86-4a28-86f1-ac2398336184 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:28.699496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 43/86] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:25:28 2022] GET /identity/v3/users/380073b53b464cf9968503ff9be682ba => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:28.700253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3627d7-1b86-4a28-86f1-ac2398336184 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:28.719134 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3f4f9-6822-4c30-bd1b-18576b22ae9d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:28.750090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:28.752228 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ae94d-5dd5-465b-9267-2c3858adf837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:28.752860 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ae94d-5dd5-465b-9267-2c3858adf837 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:28.753150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ae94d-5dd5-465b-9267-2c3858adf837 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:28.753415 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ae94d-5dd5-465b-9267-2c3858adf837 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:28.754051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ae94d-5dd5-465b-9267-2c3858adf837 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:28.755495 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ae94d-5dd5-465b-9267-2c3858adf837 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:28.799815 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3627d7-1b86-4a28-86f1-ac2398336184 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:28.834158 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd68ee-24f7-406d-9e50-08de4f20cb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:28.834788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd68ee-24f7-406d-9e50-08de4f20cb4f None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:28.835075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd68ee-24f7-406d-9e50-08de4f20cb4f None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:28.835354 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd68ee-24f7-406d-9e50-08de4f20cb4f None admin] PATH_INFO: `/v3/users/380073b53b464cf9968503ff9be682ba` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:28.836507 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd68ee-24f7-406d-9e50-08de4f20cb4f None admin] RBAC: Authorizing `identity:get_user(user_id=380073b53b464cf9968503ff9be682ba)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:28.838209 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd68ee-24f7-406d-9e50-08de4f20cb4f None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:28.839779 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 44/87] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:25:28 2022] GET /identity/v3/users/380073b53b464cf9968503ff9be682ba => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:28.840572 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd68ee-24f7-406d-9e50-08de4f20cb4f None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:28.878613 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 44/88] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Aug 22 20:25:28 2022] POST /identity/v3/users => generated 289 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:25:28.879370 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ae94d-5dd5-465b-9267-2c3858adf837 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:28.939898 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:28.955846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd68ee-24f7-406d-9e50-08de4f20cb4f None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:28.975056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:28.990441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ae94d-5dd5-465b-9267-2c3858adf837 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:28.996821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc930fa2-1464-4582-afc1-1f5d33c86775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:28.997511 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc930fa2-1464-4582-afc1-1f5d33c86775 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:28.997798 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc930fa2-1464-4582-afc1-1f5d33c86775 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:28.998079 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc930fa2-1464-4582-afc1-1f5d33c86775 None admin] PATH_INFO: `/v3/projects/3883b1b257924533a84cbc24a92ea6e1` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:28.999713 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc930fa2-1464-4582-afc1-1f5d33c86775 None admin] RBAC: Authorizing `identity:get_project(project_id=3883b1b257924533a84cbc24a92ea6e1)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:29.000787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc930fa2-1464-4582-afc1-1f5d33c86775 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:29.007606 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 45/89] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:25:28 2022] GET /identity/v3/projects/3883b1b257924533a84cbc24a92ea6e1 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:29.007606 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc930fa2-1464-4582-afc1-1f5d33c86775 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:29.033764 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbcf620-1d9b-4f93-b97d-a90da565ef43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:29.034844 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcf620-1d9b-4f93-b97d-a90da565ef43 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:29.035267 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcf620-1d9b-4f93-b97d-a90da565ef43 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:29.036082 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcf620-1d9b-4f93-b97d-a90da565ef43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:29.036875 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbcf620-1d9b-4f93-b97d-a90da565ef43 None admin] RBAC: Adding query filter params (role.id=028945f544094c26933c8ef60a480e9a, scope.project.id=3883b1b257924533a84cbc24a92ea6e1, user.id=380073b53b464cf9968503ff9be682ba) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:29.037191 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbcf620-1d9b-4f93-b97d-a90da565ef43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:29.038676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbcf620-1d9b-4f93-b97d-a90da565ef43 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:29.046779 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 45/90] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:25:28 2022] GET /identity/v3/role_assignments?user.id=380073b53b464cf9968503ff9be682ba&scope.project.id=3883b1b257924533a84cbc24a92ea6e1&role.id=028945f544094c26933c8ef60a480e9a => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:29.047716 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbcf620-1d9b-4f93-b97d-a90da565ef43 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:29.139468 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc930fa2-1464-4582-afc1-1f5d33c86775 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:29.181529 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d489ea-2d73-41b9-be36-60dffd4cc364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:29.182628 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d489ea-2d73-41b9-be36-60dffd4cc364 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:29.182919 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d489ea-2d73-41b9-be36-60dffd4cc364 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:29.183199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d489ea-2d73-41b9-be36-60dffd4cc364 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:29.190501 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbcf620-1d9b-4f93-b97d-a90da565ef43 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:29.213865 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:29.236264 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceedbdc-e45c-4555-9d55-d24f4a58fa66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:29.240432 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceedbdc-e45c-4555-9d55-d24f4a58fa66 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:29.240432 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceedbdc-e45c-4555-9d55-d24f4a58fa66 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:29.240432 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceedbdc-e45c-4555-9d55-d24f4a58fa66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:29.263970 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:29.284181 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d489ea-2d73-41b9-be36-60dffd4cc364 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:29.286274 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d489ea-2d73-41b9-be36-60dffd4cc364 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:29.337001 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceedbdc-e45c-4555-9d55-d24f4a58fa66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:29.339499 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceedbdc-e45c-4555-9d55-d24f4a58fa66 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:29.411825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 46/91] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:25:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:25:29.412992 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d489ea-2d73-41b9-be36-60dffd4cc364 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:29.457789 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 46/92] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:25:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:25:29.458871 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceedbdc-e45c-4555-9d55-d24f4a58fa66 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:29.478027 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:29.517048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:29.528986 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d489ea-2d73-41b9-be36-60dffd4cc364 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:29.576868 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceedbdc-e45c-4555-9d55-d24f4a58fa66 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:29.591331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b09c7-138b-4e27-9692-7b056b4b83db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:29.592542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b09c7-138b-4e27-9692-7b056b4b83db None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:29.597282 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b09c7-138b-4e27-9692-7b056b4b83db None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:29.597282 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b09c7-138b-4e27-9692-7b056b4b83db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:29.597282 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b09c7-138b-4e27-9692-7b056b4b83db None admin] RBAC: Adding query filter params (role.id=e3faa0474c054da6bb4d8910a4e40bff, scope.project.id=3883b1b257924533a84cbc24a92ea6e1, user.id=1d89af55e2b04afa9fa5ae15b3027c4e) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:29.597282 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b09c7-138b-4e27-9692-7b056b4b83db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:29.597282 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b09c7-138b-4e27-9692-7b056b4b83db None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:29.610699 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 47/93] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:25:29 2022] GET /identity/v3/role_assignments?user.id=1d89af55e2b04afa9fa5ae15b3027c4e&scope.project.id=3883b1b257924533a84cbc24a92ea6e1&role.id=e3faa0474c054da6bb4d8910a4e40bff => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:29.611833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b09c7-138b-4e27-9692-7b056b4b83db None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:29.616688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9fef6-b181-4798-ac91-72bba67157ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:29.616688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9fef6-b181-4798-ac91-72bba67157ce None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:29.616688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9fef6-b181-4798-ac91-72bba67157ce None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:29.616688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9fef6-b181-4798-ac91-72bba67157ce None admin] PATH_INFO: `/v3/projects/2002e6bffe8648ccb9cb0fb3f1e1b8bd` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:29.617076 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9fef6-b181-4798-ac91-72bba67157ce None admin] RBAC: Authorizing `identity:get_project(project_id=2002e6bffe8648ccb9cb0fb3f1e1b8bd)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:29.618440 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e9fef6-b181-4798-ac91-72bba67157ce None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:29.620416 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 47/94] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:25:29 2022] GET /identity/v3/projects/2002e6bffe8648ccb9cb0fb3f1e1b8bd => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:29.626918 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9fef6-b181-4798-ac91-72bba67157ce None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:29.744541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b09c7-138b-4e27-9692-7b056b4b83db None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:29.793860 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666b264-879c-4488-92eb-502d1893a60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:29.794783 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666b264-879c-4488-92eb-502d1893a60d None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:29.795242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666b264-879c-4488-92eb-502d1893a60d None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:29.795639 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666b264-879c-4488-92eb-502d1893a60d None admin] PATH_INFO: `/v3/projects/3883b1b257924533a84cbc24a92ea6e1` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:29.797068 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666b264-879c-4488-92eb-502d1893a60d None admin] RBAC: Authorizing `identity:get_project(project_id=3883b1b257924533a84cbc24a92ea6e1)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:29.799696 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666b264-879c-4488-92eb-502d1893a60d None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:29.800556 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 48/95] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:25:29 2022] GET /identity/v3/projects/3883b1b257924533a84cbc24a92ea6e1 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:29.808724 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666b264-879c-4488-92eb-502d1893a60d None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:29.827008 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:29.860325 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9fef6-b181-4798-ac91-72bba67157ce None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:29.861031 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:29.936055 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7720e-9892-42c6-bc42-7e887c91faea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:29.936691 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7720e-9892-42c6-bc42-7e887c91faea None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:29.936984 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7720e-9892-42c6-bc42-7e887c91faea None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:29.937261 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7720e-9892-42c6-bc42-7e887c91faea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:29.938010 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7720e-9892-42c6-bc42-7e887c91faea None admin] RBAC: Adding query filter params (role.id=028945f544094c26933c8ef60a480e9a, scope.project.id=2002e6bffe8648ccb9cb0fb3f1e1b8bd, user.id=380073b53b464cf9968503ff9be682ba) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:29.938324 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7720e-9892-42c6-bc42-7e887c91faea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:29.939795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7720e-9892-42c6-bc42-7e887c91faea None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:29.952841 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 48/96] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:25:29 2022] GET /identity/v3/role_assignments?user.id=380073b53b464cf9968503ff9be682ba&scope.project.id=2002e6bffe8648ccb9cb0fb3f1e1b8bd&role.id=028945f544094c26933c8ef60a480e9a => generated 259 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:29.980471 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666b264-879c-4488-92eb-502d1893a60d None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:30.019146 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc3795-e376-41ea-87d4-d6b3f94b2574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:30.019688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc3795-e376-41ea-87d4-d6b3f94b2574 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:30.019976 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc3795-e376-41ea-87d4-d6b3f94b2574 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:30.020258 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc3795-e376-41ea-87d4-d6b3f94b2574 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:30.021046 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc3795-e376-41ea-87d4-d6b3f94b2574 None admin] RBAC: Adding query filter params (role.id=7f4b8cdb739c4f808ef31961eb11510e, scope.project.id=3883b1b257924533a84cbc24a92ea6e1, user.id=380073b53b464cf9968503ff9be682ba) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:30.021362 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc3795-e376-41ea-87d4-d6b3f94b2574 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:30.022853 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc3795-e376-41ea-87d4-d6b3f94b2574 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:30.029165 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 49/97] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:25:29 2022] GET /identity/v3/role_assignments?user.id=380073b53b464cf9968503ff9be682ba&scope.project.id=3883b1b257924533a84cbc24a92ea6e1&role.id=7f4b8cdb739c4f808ef31961eb11510e => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:25:31.675467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048578b0-7521-4cbc-a839-a83276e5e544 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:31.676481 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048578b0-7521-4cbc-a839-a83276e5e544 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:31.677016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048578b0-7521-4cbc-a839-a83276e5e544 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:31.678556 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 49/98] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:31.694185 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75962d-bc63-4afa-ad06-d14ecc979d7d None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:31.694670 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75962d-bc63-4afa-ad06-d14ecc979d7d None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:31.694771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75962d-bc63-4afa-ad06-d14ecc979d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:31.717696 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-1d75962d-bc63-4afa-ad06-d14ecc979d7d None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:31.718938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-1d75962d-bc63-4afa-ad06-d14ecc979d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:31.822777 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 50/99] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:25:32.117114 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9887b57-acc9-4595-bcfd-ebbf80b6bfd1 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:32.117467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9887b57-acc9-4595-bcfd-ebbf80b6bfd1 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:32.117653 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9887b57-acc9-4595-bcfd-ebbf80b6bfd1 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:32.119678 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 50/100] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:32.124994 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc481f-6fe1-4249-9105-a4527f37e89b None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:32.125288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc481f-6fe1-4249-9105-a4527f37e89b None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:32.125575 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc481f-6fe1-4249-9105-a4527f37e89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:32.146563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-f8fc481f-6fe1-4249-9105-a4527f37e89b None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:32.147770 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-f8fc481f-6fe1-4249-9105-a4527f37e89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:32.156020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:32.227615 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 51/101] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:25:32.360781 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9887b57-acc9-4595-bcfd-ebbf80b6bfd1 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:32.390395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb603e-d590-43a3-94ee-351424888d63 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:32.390675 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb603e-d590-43a3-94ee-351424888d63 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:32.390955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb603e-d590-43a3-94ee-351424888d63 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:32.392289 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 52/102] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:25:32.398092 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd97ed-1baf-4737-9ae9-03e49d621c51 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:32.398898 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd97ed-1baf-4737-9ae9-03e49d621c51 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:32.399380 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd97ed-1baf-4737-9ae9-03e49d621c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:32.422196 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-15cd97ed-1baf-4737-9ae9-03e49d621c51 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:32.423725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-15cd97ed-1baf-4737-9ae9-03e49d621c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:32.503059 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9887b57-acc9-4595-bcfd-ebbf80b6bfd1 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:32.539911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519faca-ec86-48bf-be94-4408a3e6b547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:32.541519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519faca-ec86-48bf-be94-4408a3e6b547 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:32.542019 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519faca-ec86-48bf-be94-4408a3e6b547 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:32.542482 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519faca-ec86-48bf-be94-4408a3e6b547 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:32.549200 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 53/103] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:25:32.550498 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ae223-7fe9-44a6-91c4-452d7e3f679c None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:32.550789 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ae223-7fe9-44a6-91c4-452d7e3f679c None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:32.551070 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ae223-7fe9-44a6-91c4-452d7e3f679c None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:32.552317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 54/104] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:32.555004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519faca-ec86-48bf-be94-4408a3e6b547 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:25:32.558025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b499759-16dc-4627-b8be-7c67a0afdce9 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:32.558314 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b499759-16dc-4627-b8be-7c67a0afdce9 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:32.558593 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b499759-16dc-4627-b8be-7c67a0afdce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:32.561583 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-6519faca-ec86-48bf-be94-4408a3e6b547 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:25:32.561583 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:25:32.561583 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:25:32.561583 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:25:32.561583 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:25:32.561583 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:25:32.561583 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:25:32.561583 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:25:32.561583 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:25:32.561583 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:25:32.561583 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:25:32.561583 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:25:32.561583 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:25:32.561583 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:25:32.561583 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:25:32.561583 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:25:32.562420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:25:32.562420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:25:32.562420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:25:32.562420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:25:32.562420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:25:32.562420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:25:32.562420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:25:32.562420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:25:32.562420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:25:32.562420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:25:32.562420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:25:32.562420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:25:32.562420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:25:32.562420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:25:32.562420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:25:32.562420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:25:32.563169 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:25:32.563169 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:25:32.563169 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:25:32.563169 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:25:32.563169 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:25:32.563169 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:25:32.563169 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:25:32.563169 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:25:32.563169 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:25:32.563169 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:25:32.563169 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:25:32.563169 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:25:32.565475 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 51/105] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:25:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:25:32.571444 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519faca-ec86-48bf-be94-4408a3e6b547 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:32.586827 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:32.601708 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-9b499759-16dc-4627-b8be-7c67a0afdce9 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:32.603489 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-9b499759-16dc-4627-b8be-7c67a0afdce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:32.686160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 55/106] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:25:32.686934 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b499759-16dc-4627-b8be-7c67a0afdce9 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:32.690966 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:32.760694 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519faca-ec86-48bf-be94-4408a3e6b547 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:32.836214 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1daea4-0d75-4209-9633-51a877acb8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:32.837819 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1daea4-0d75-4209-9633-51a877acb8c6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:32.838279 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1daea4-0d75-4209-9633-51a877acb8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:32.838724 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1daea4-0d75-4209-9633-51a877acb8c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:32.839568 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1daea4-0d75-4209-9633-51a877acb8c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:32.840062 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1daea4-0d75-4209-9633-51a877acb8c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:32.841655 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1daea4-0d75-4209-9633-51a877acb8c6 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:32.853608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b499759-16dc-4627-b8be-7c67a0afdce9 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:32.857265 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 52/107] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 22 20:25:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:32.862920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1daea4-0d75-4209-9633-51a877acb8c6 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:32.907248 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d260fa-3bf1-4c91-8340-e1e200091ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:32.908259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d260fa-3bf1-4c91-8340-e1e200091ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:32.908768 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d260fa-3bf1-4c91-8340-e1e200091ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:32.909235 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d260fa-3bf1-4c91-8340-e1e200091ef6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:32.922349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d260fa-3bf1-4c91-8340-e1e200091ef6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:25:32.927530 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-c2d260fa-3bf1-4c91-8340-e1e200091ef6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:25:32.927530 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:25:32.927530 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:25:32.927530 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:25:32.927530 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:25:32.927530 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:25:32.927530 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:25:32.927530 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:25:32.927530 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:25:32.927530 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:25:32.927530 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:25:32.927530 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:25:32.927530 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:25:32.927530 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:25:32.927530 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:25:32.927530 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:25:32.928341 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:25:32.928341 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:25:32.928341 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:25:32.928341 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:25:32.928341 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:25:32.928341 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:25:32.928341 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:25:32.928341 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:25:32.928341 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:25:32.928341 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:25:32.928341 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:25:32.928341 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:25:32.928341 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:25:32.928341 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:25:32.928341 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:25:32.928341 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:25:32.929133 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:25:32.929133 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:25:32.929133 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:25:32.929133 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:25:32.929133 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:25:32.929133 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:25:32.929133 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:25:32.929133 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:25:32.929133 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:25:32.929133 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:25:32.929133 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:25:32.929133 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:25:32.931089 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 56/108] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:25:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:25:32.935884 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427db5e-84a1-4e81-a556-dd1207436de8 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:32.935884 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427db5e-84a1-4e81-a556-dd1207436de8 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:32.935884 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427db5e-84a1-4e81-a556-dd1207436de8 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:32.936828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 57/109] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:32.940625 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037618ce-3b74-40d1-90c7-76f6bc4a7d9c None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:32.940625 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037618ce-3b74-40d1-90c7-76f6bc4a7d9c None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:32.940625 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037618ce-3b74-40d1-90c7-76f6bc4a7d9c None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:32.940625 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 58/110] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:32.940625 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037618ce-3b74-40d1-90c7-76f6bc4a7d9c None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:32.955810 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:32.995723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1daea4-0d75-4209-9633-51a877acb8c6 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:33.017391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:33.032168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d20201-a6d5-43d2-b242-864a11f33d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:33.032848 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d20201-a6d5-43d2-b242-864a11f33d8e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:33.033131 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d20201-a6d5-43d2-b242-864a11f33d8e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:33.033408 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d20201-a6d5-43d2-b242-864a11f33d8e None admin] PATH_INFO: `/v3/users/380073b53b464cf9968503ff9be682ba` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:33.034578 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d20201-a6d5-43d2-b242-864a11f33d8e None admin] RBAC: Authorizing `identity:get_user(user_id=380073b53b464cf9968503ff9be682ba)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:33.036052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d20201-a6d5-43d2-b242-864a11f33d8e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:33.037671 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 53/111] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:25:32 2022] GET /identity/v3/users/380073b53b464cf9968503ff9be682ba => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:25:33.042261 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da66416-b020-429a-8154-fa2e6f21ab84 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:33.042642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da66416-b020-429a-8154-fa2e6f21ab84 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:33.042944 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da66416-b020-429a-8154-fa2e6f21ab84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:33.059714 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037618ce-3b74-40d1-90c7-76f6bc4a7d9c None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:33.061613 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-7da66416-b020-429a-8154-fa2e6f21ab84 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:33.062846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7da66416-b020-429a-8154-fa2e6f21ab84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:33.095013 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ab335-f331-4264-a9c8-569f6b1aa0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:33.095623 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ab335-f331-4264-a9c8-569f6b1aa0c5 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:33.095906 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ab335-f331-4264-a9c8-569f6b1aa0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:33.096181 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ab335-f331-4264-a9c8-569f6b1aa0c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:33.096877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ab335-f331-4264-a9c8-569f6b1aa0c5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:33.097187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ab335-f331-4264-a9c8-569f6b1aa0c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:33.098578 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ab335-f331-4264-a9c8-569f6b1aa0c5 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:33.107022 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 59/112] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 22 20:25:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:33.112750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0d8fa-085e-4660-a589-1bf5ce38fdeb None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:33.113044 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0d8fa-085e-4660-a589-1bf5ce38fdeb None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:33.113325 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0d8fa-085e-4660-a589-1bf5ce38fdeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:33.130739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 54/113] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:25:33.130964 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-b0c0d8fa-085e-4660-a589-1bf5ce38fdeb None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:33.132190 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b0c0d8fa-085e-4660-a589-1bf5ce38fdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:33.132541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da66416-b020-429a-8154-fa2e6f21ab84 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:33.203452 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 60/114] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:25:33.204219 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0d8fa-085e-4660-a589-1bf5ce38fdeb None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:33.209703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:33.248741 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da66416-b020-429a-8154-fa2e6f21ab84 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:33.287253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f21bf9-80a7-4245-b164-6cdc910ed83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:33.288056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f21bf9-80a7-4245-b164-6cdc910ed83e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:33.288401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:33.288514 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f21bf9-80a7-4245-b164-6cdc910ed83e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:33.288915 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f21bf9-80a7-4245-b164-6cdc910ed83e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:33.301726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f21bf9-80a7-4245-b164-6cdc910ed83e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:25:33.308351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-16f21bf9-80a7-4245-b164-6cdc910ed83e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:25:33.308351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:25:33.308351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:25:33.308351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:25:33.308351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:25:33.308351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:25:33.308351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:25:33.308351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:25:33.308351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:25:33.308351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:25:33.308351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:25:33.308351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:25:33.308351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:25:33.308351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:25:33.308351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:25:33.308351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:25:33.309470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:25:33.309470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:25:33.309470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:25:33.309470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:25:33.309470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:25:33.309470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:25:33.309470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:25:33.309470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:25:33.309470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:25:33.309470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:25:33.309470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:25:33.309470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:25:33.309470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:25:33.309470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:25:33.309470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:25:33.309470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:25:33.310491 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:25:33.310491 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:25:33.310491 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:25:33.310491 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:25:33.310491 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:25:33.310491 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:25:33.310491 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:25:33.310491 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:25:33.310491 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:25:33.310491 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:25:33.310491 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:25:33.310491 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:25:33.312234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 55/115] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 22 20:25:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:25:33.313041 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f21bf9-80a7-4245-b164-6cdc910ed83e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:33.343875 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0d8fa-085e-4660-a589-1bf5ce38fdeb None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:33.379661 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3d00f-be1d-46ae-adc5-1284f2120c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:33.380510 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3d00f-be1d-46ae-adc5-1284f2120c7f None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:33.380993 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3d00f-be1d-46ae-adc5-1284f2120c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:33.381441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf3d00f-be1d-46ae-adc5-1284f2120c7f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:33.382752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3d00f-be1d-46ae-adc5-1284f2120c7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:33.384462 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf3d00f-be1d-46ae-adc5-1284f2120c7f None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:33.386256 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 61/116] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:25:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:33.391688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3d00f-be1d-46ae-adc5-1284f2120c7f None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:33.425373 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f21bf9-80a7-4245-b164-6cdc910ed83e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:33.453867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:33.463520 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb216b4-8f29-4b1e-ad87-faa830b7d81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:33.464151 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb216b4-8f29-4b1e-ad87-faa830b7d81e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:33.464452 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb216b4-8f29-4b1e-ad87-faa830b7d81e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:33.465498 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb216b4-8f29-4b1e-ad87-faa830b7d81e None admin] PATH_INFO: `/v3/projects/3883b1b257924533a84cbc24a92ea6e1` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:33.466117 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb216b4-8f29-4b1e-ad87-faa830b7d81e None admin] RBAC: Authorizing `identity:get_project(project_id=3883b1b257924533a84cbc24a92ea6e1)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:33.468968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb216b4-8f29-4b1e-ad87-faa830b7d81e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:33.469793 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 56/117] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:25:33 2022] GET /identity/v3/projects/3883b1b257924533a84cbc24a92ea6e1 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:33.470315 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb216b4-8f29-4b1e-ad87-faa830b7d81e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:33.499330 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf3d00f-be1d-46ae-adc5-1284f2120c7f None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:33.522136 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:33.533988 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb170ca8-1778-4c94-8638-2a6cc5522aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:33.537655 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb170ca8-1778-4c94-8638-2a6cc5522aae None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:33.537655 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb170ca8-1778-4c94-8638-2a6cc5522aae None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:33.537655 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb170ca8-1778-4c94-8638-2a6cc5522aae None admin] PATH_INFO: `/v3/users/41d69b9a30df40f8ad2c9b4ef7d636a4` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:33.549272 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb170ca8-1778-4c94-8638-2a6cc5522aae None admin] RBAC: Authorizing `identity:get_user(user_id=41d69b9a30df40f8ad2c9b4ef7d636a4)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:33.550750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb170ca8-1778-4c94-8638-2a6cc5522aae None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:33.552361 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 62/118] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:25:33 2022] GET /identity/v3/users/41d69b9a30df40f8ad2c9b4ef7d636a4 => generated 289 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:33.557540 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb170ca8-1778-4c94-8638-2a6cc5522aae None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:33.578459 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb216b4-8f29-4b1e-ad87-faa830b7d81e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:33.613355 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ae154-ed70-4fa3-85bf-2bb81b3e5f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:33.613964 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ae154-ed70-4fa3-85bf-2bb81b3e5f75 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:33.614249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ae154-ed70-4fa3-85bf-2bb81b3e5f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:33.614523 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ae154-ed70-4fa3-85bf-2bb81b3e5f75 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:33.615221 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ae154-ed70-4fa3-85bf-2bb81b3e5f75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:33.615531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ae154-ed70-4fa3-85bf-2bb81b3e5f75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:33.617039 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ae154-ed70-4fa3-85bf-2bb81b3e5f75 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:33.625170 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 57/119] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:25:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:33.629952 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ae154-ed70-4fa3-85bf-2bb81b3e5f75 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:33.663793 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb170ca8-1778-4c94-8638-2a6cc5522aae None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:33.684095 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:33.697746 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f4753-8791-4e44-ae0d-10ca5f7241fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:33.698351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f4753-8791-4e44-ae0d-10ca5f7241fc None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:33.698685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f4753-8791-4e44-ae0d-10ca5f7241fc None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:33.698968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f4753-8791-4e44-ae0d-10ca5f7241fc None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:33.699611 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f4753-8791-4e44-ae0d-10ca5f7241fc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:33.701100 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f4753-8791-4e44-ae0d-10ca5f7241fc None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:33.734572 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ae154-ed70-4fa3-85bf-2bb81b3e5f75 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:33.758365 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140dec7-dcf3-44e5-98b3-869477b269a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:33.759479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140dec7-dcf3-44e5-98b3-869477b269a8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:33.759747 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140dec7-dcf3-44e5-98b3-869477b269a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:33.760017 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140dec7-dcf3-44e5-98b3-869477b269a8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:33.769817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140dec7-dcf3-44e5-98b3-869477b269a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:25:33.775602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-1140dec7-dcf3-44e5-98b3-869477b269a8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:25:33.775602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:25:33.775602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:25:33.775602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:25:33.775602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:25:33.775602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:25:33.775602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:25:33.775602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:25:33.775602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:25:33.775602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:25:33.775602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:25:33.775602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:25:33.775602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:25:33.775602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:25:33.775602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:25:33.775602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:25:33.776675 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:25:33.776675 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:25:33.776675 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:25:33.776675 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:25:33.776675 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:25:33.776675 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:25:33.776675 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:25:33.776675 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:25:33.776675 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:25:33.776675 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:25:33.776675 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:25:33.776675 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:25:33.776675 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:25:33.776675 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:25:33.776675 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:25:33.776675 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:25:33.777577 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:25:33.777577 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:25:33.777577 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:25:33.777577 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:25:33.777577 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:25:33.777577 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:25:33.777577 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:25:33.777577 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:25:33.777577 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:25:33.777577 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:25:33.777577 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:25:33.777577 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:25:33.777577 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 58/120] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 22 20:25:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:25:33.777577 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140dec7-dcf3-44e5-98b3-869477b269a8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:33.793009 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 63/121] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Aug 22 20:25:33 2022] POST /identity/v3/projects => generated 302 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:25:33.794124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f4753-8791-4e44-ae0d-10ca5f7241fc None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:33.831280 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:33.907550 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140dec7-dcf3-44e5-98b3-869477b269a8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:33.918127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f4753-8791-4e44-ae0d-10ca5f7241fc None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:33.926937 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:33.947909 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4f417-fba5-4a5d-be00-62a600e4426e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:33.948630 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4f417-fba5-4a5d-be00-62a600e4426e None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:33.948943 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4f417-fba5-4a5d-be00-62a600e4426e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:33.949219 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4f417-fba5-4a5d-be00-62a600e4426e None admin] PATH_INFO: `/v3/projects/3883b1b257924533a84cbc24a92ea6e1/users/380073b53b464cf9968503ff9be682ba/roles/028945f544094c26933c8ef60a480e9a` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:33.951136 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f4f417-fba5-4a5d-be00-62a600e4426e None admin] RBAC: Authorizing `identity:create_grant(project_id=3883b1b257924533a84cbc24a92ea6e1, user_id=380073b53b464cf9968503ff9be682ba, role_id=028945f544094c26933c8ef60a480e9a)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:33.953608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f4f417-fba5-4a5d-be00-62a600e4426e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:33.960818 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17083a0a-8844-4ece-992f-01ae49845415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:33.961459 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17083a0a-8844-4ece-992f-01ae49845415 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:33.961750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17083a0a-8844-4ece-992f-01ae49845415 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:33.962588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17083a0a-8844-4ece-992f-01ae49845415 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:33.973767 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17083a0a-8844-4ece-992f-01ae49845415 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:25:33.979445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-17083a0a-8844-4ece-992f-01ae49845415 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:25:33.979445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:25:33.979445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:25:33.979445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:25:33.979445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:25:33.979445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:25:33.979445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:25:33.979445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:25:33.979445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:25:33.979445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:25:33.979445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:25:33.979445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:25:33.979445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:25:33.979445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:25:33.979445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:25:33.979445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:25:33.982026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:25:33.982026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:25:33.982026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:25:33.982026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:25:33.982026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:25:33.982026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:25:33.982026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:25:33.982026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:25:33.982026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:25:33.982026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:25:33.982026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:25:33.982026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:25:33.982026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:25:33.982026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:25:33.982026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:25:33.982026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:25:33.982791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:25:33.982791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:25:33.982791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:25:33.982791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:25:33.982791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:25:33.982791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:25:33.982791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:25:33.982791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:25:33.982791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:25:33.982791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:25:33.982791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:25:33.982791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:25:33.982791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 64/122] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:25:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:25:33.982791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17083a0a-8844-4ece-992f-01ae49845415 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:34.028504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 59/123] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 22 20:25:33 2022] PUT /identity/v3/projects/3883b1b257924533a84cbc24a92ea6e1/users/380073b53b464cf9968503ff9be682ba/roles/028945f544094c26933c8ef60a480e9a => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:25:34.037404 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4f417-fba5-4a5d-be00-62a600e4426e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:34.096828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:34.112224 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17083a0a-8844-4ece-992f-01ae49845415 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:34.160814 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b6d40-1992-423a-badd-0c1121d39f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:34.161529 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b6d40-1992-423a-badd-0c1121d39f37 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:34.161968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b6d40-1992-423a-badd-0c1121d39f37 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:34.162254 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59b6d40-1992-423a-badd-0c1121d39f37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:34.191647 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4f417-fba5-4a5d-be00-62a600e4426e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:34.245284 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27937fb3-26f6-4d8e-b0a5-9bcc6058b7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:34.246160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27937fb3-26f6-4d8e-b0a5-9bcc6058b7ea None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:34.246448 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27937fb3-26f6-4d8e-b0a5-9bcc6058b7ea None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:34.246728 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27937fb3-26f6-4d8e-b0a5-9bcc6058b7ea None admin] PATH_INFO: `/v3/users/1d89af55e2b04afa9fa5ae15b3027c4e` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:34.248100 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27937fb3-26f6-4d8e-b0a5-9bcc6058b7ea None admin] RBAC: Authorizing `identity:get_user(user_id=1d89af55e2b04afa9fa5ae15b3027c4e)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:34.249866 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27937fb3-26f6-4d8e-b0a5-9bcc6058b7ea None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:34.252452 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 60/124] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:25:34 2022] GET /identity/v3/users/1d89af55e2b04afa9fa5ae15b3027c4e => generated 247 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:34.252979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b6d40-1992-423a-badd-0c1121d39f37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:34.253263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27937fb3-26f6-4d8e-b0a5-9bcc6058b7ea None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:34.255043 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59b6d40-1992-423a-badd-0c1121d39f37 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:34.317016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:34.370822 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:34.388078 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 65/125] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:25:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:25:34.388078 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b6d40-1992-423a-badd-0c1121d39f37 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:34.390290 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27937fb3-26f6-4d8e-b0a5-9bcc6058b7ea None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:34.431875 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a982dd-299e-45d2-9733-4d2def8c078d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:34.432879 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a982dd-299e-45d2-9733-4d2def8c078d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:34.433362 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a982dd-299e-45d2-9733-4d2def8c078d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:34.433803 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a982dd-299e-45d2-9733-4d2def8c078d None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:34.434641 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a982dd-299e-45d2-9733-4d2def8c078d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:34.435217 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a982dd-299e-45d2-9733-4d2def8c078d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:34.436816 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a982dd-299e-45d2-9733-4d2def8c078d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:34.447825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 61/126] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:25:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:34.449049 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a982dd-299e-45d2-9733-4d2def8c078d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:34.511537 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59b6d40-1992-423a-badd-0c1121d39f37 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:34.556310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce25a4e-579b-4890-97f4-c21bc3cc4e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:34.556831 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce25a4e-579b-4890-97f4-c21bc3cc4e72 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:34.557465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce25a4e-579b-4890-97f4-c21bc3cc4e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:34.557741 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce25a4e-579b-4890-97f4-c21bc3cc4e72 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:34.558671 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce25a4e-579b-4890-97f4-c21bc3cc4e72 None admin] RBAC: Adding query filter params (name=member) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:34.558977 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce25a4e-579b-4890-97f4-c21bc3cc4e72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:34.560776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce25a4e-579b-4890-97f4-c21bc3cc4e72 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:34.569258 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a982dd-299e-45d2-9733-4d2def8c078d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:34.574132 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 66/127] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 22 20:25:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:34.575138 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce25a4e-579b-4890-97f4-c21bc3cc4e72 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:34.585126 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:34.616607 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7394221-60af-4f49-879f-2aae0d7c7871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:34.617429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7394221-60af-4f49-879f-2aae0d7c7871 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:34.617713 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7394221-60af-4f49-879f-2aae0d7c7871 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:34.617990 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7394221-60af-4f49-879f-2aae0d7c7871 None admin] PATH_INFO: `/v3/projects/3883b1b257924533a84cbc24a92ea6e1` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:34.620898 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7394221-60af-4f49-879f-2aae0d7c7871 None admin] RBAC: Authorizing `identity:get_project(project_id=3883b1b257924533a84cbc24a92ea6e1)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:34.622378 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7394221-60af-4f49-879f-2aae0d7c7871 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:34.624018 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 62/128] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:25:34 2022] GET /identity/v3/projects/3883b1b257924533a84cbc24a92ea6e1 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:34.624802 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7394221-60af-4f49-879f-2aae0d7c7871 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:34.643588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:34.698312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce25a4e-579b-4890-97f4-c21bc3cc4e72 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:34.739050 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912479a1-fd4d-43ed-8fae-a2fc2ee7edb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:34.740022 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912479a1-fd4d-43ed-8fae-a2fc2ee7edb2 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:34.740495 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912479a1-fd4d-43ed-8fae-a2fc2ee7edb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:34.740975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912479a1-fd4d-43ed-8fae-a2fc2ee7edb2 None admin] PATH_INFO: `/v3/projects/3883b1b257924533a84cbc24a92ea6e1` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:34.742318 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912479a1-fd4d-43ed-8fae-a2fc2ee7edb2 None admin] RBAC: Authorizing `identity:get_project(project_id=3883b1b257924533a84cbc24a92ea6e1)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:34.745960 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912479a1-fd4d-43ed-8fae-a2fc2ee7edb2 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:34.747946 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 67/129] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:25:34 2022] GET /identity/v3/projects/3883b1b257924533a84cbc24a92ea6e1 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:34.749015 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912479a1-fd4d-43ed-8fae-a2fc2ee7edb2 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:34.755796 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7394221-60af-4f49-879f-2aae0d7c7871 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:34.796816 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf955de4-707b-4d9c-84e3-3b8db83ef78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:34.797462 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf955de4-707b-4d9c-84e3-3b8db83ef78a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:34.797743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf955de4-707b-4d9c-84e3-3b8db83ef78a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:34.798016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf955de4-707b-4d9c-84e3-3b8db83ef78a None admin] PATH_INFO: `/v3/users/380073b53b464cf9968503ff9be682ba` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:34.799148 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf955de4-707b-4d9c-84e3-3b8db83ef78a None admin] RBAC: Authorizing `identity:get_user(user_id=380073b53b464cf9968503ff9be682ba)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:34.801873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf955de4-707b-4d9c-84e3-3b8db83ef78a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:34.803713 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 63/130] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:25:34 2022] GET /identity/v3/users/380073b53b464cf9968503ff9be682ba => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:34.805196 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf955de4-707b-4d9c-84e3-3b8db83ef78a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:34.857776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:34.864188 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912479a1-fd4d-43ed-8fae-a2fc2ee7edb2 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:34.889869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:34.902423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dc37e-5cb5-4b73-8e2b-9ab3df7c3c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:34.903130 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dc37e-5cb5-4b73-8e2b-9ab3df7c3c48 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:34.903417 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dc37e-5cb5-4b73-8e2b-9ab3df7c3c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:34.903754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dc37e-5cb5-4b73-8e2b-9ab3df7c3c48 None admin] PATH_INFO: `/v3/users/380073b53b464cf9968503ff9be682ba` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:34.904936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1dc37e-5cb5-4b73-8e2b-9ab3df7c3c48 None admin] RBAC: Authorizing `identity:get_user(user_id=380073b53b464cf9968503ff9be682ba)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:34.906391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1dc37e-5cb5-4b73-8e2b-9ab3df7c3c48 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:34.908316 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 68/131] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:25:34 2022] GET /identity/v3/users/380073b53b464cf9968503ff9be682ba => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:34.909124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dc37e-5cb5-4b73-8e2b-9ab3df7c3c48 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:34.920164 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf955de4-707b-4d9c-84e3-3b8db83ef78a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:34.961073 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ae67c-2fbf-4e89-b319-e528d3a8b88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:34.961741 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ae67c-2fbf-4e89-b319-e528d3a8b88b None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:34.962577 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ae67c-2fbf-4e89-b319-e528d3a8b88b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:34.962849 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ae67c-2fbf-4e89-b319-e528d3a8b88b None admin] PATH_INFO: `/v3/projects/3883b1b257924533a84cbc24a92ea6e1/users/1d89af55e2b04afa9fa5ae15b3027c4e/roles/e3faa0474c054da6bb4d8910a4e40bff` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:34.965027 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ae67c-2fbf-4e89-b319-e528d3a8b88b None admin] RBAC: Authorizing `identity:create_grant(project_id=3883b1b257924533a84cbc24a92ea6e1, user_id=1d89af55e2b04afa9fa5ae15b3027c4e, role_id=e3faa0474c054da6bb4d8910a4e40bff)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:34.966649 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ae67c-2fbf-4e89-b319-e528d3a8b88b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:35.023008 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dc37e-5cb5-4b73-8e2b-9ab3df7c3c48 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:35.063840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8dd66b-b3d9-447e-a45d-a142a4e86d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:35.064462 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dd66b-b3d9-447e-a45d-a142a4e86d0f None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:35.064771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dd66b-b3d9-447e-a45d-a142a4e86d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:35.065056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8dd66b-b3d9-447e-a45d-a142a4e86d0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:35.065867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8dd66b-b3d9-447e-a45d-a142a4e86d0f None admin] RBAC: Adding query filter params (role.id=c1ddd6c095d041d4a18c8cf126582891, scope.project.id=3883b1b257924533a84cbc24a92ea6e1, user.id=41d69b9a30df40f8ad2c9b4ef7d636a4) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:35.066179 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8dd66b-b3d9-447e-a45d-a142a4e86d0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:35.066670 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 64/132] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 22 20:25:34 2022] PUT /identity/v3/projects/3883b1b257924533a84cbc24a92ea6e1/users/1d89af55e2b04afa9fa5ae15b3027c4e/roles/e3faa0474c054da6bb4d8910a4e40bff => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:25:35.067383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ae67c-2fbf-4e89-b319-e528d3a8b88b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:35.067678 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8dd66b-b3d9-447e-a45d-a142a4e86d0f None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:35.083677 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 69/133] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:25:34 2022] GET /identity/v3/role_assignments?user.id=41d69b9a30df40f8ad2c9b4ef7d636a4&scope.project.id=3883b1b257924533a84cbc24a92ea6e1&role.id=c1ddd6c095d041d4a18c8cf126582891 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:35.084804 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8dd66b-b3d9-447e-a45d-a142a4e86d0f None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:35.218631 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:35.300011 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8dd66b-b3d9-447e-a45d-a142a4e86d0f None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:35.320492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ae67c-2fbf-4e89-b319-e528d3a8b88b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:35.326203 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:35.344111 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa057f-1bd0-45fe-b59c-6ce9beaf4bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:35.345588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa057f-1bd0-45fe-b59c-6ce9beaf4bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:35.345588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa057f-1bd0-45fe-b59c-6ce9beaf4bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:35.345588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa057f-1bd0-45fe-b59c-6ce9beaf4bf3 None admin] PATH_INFO: `/v3/projects/2002e6bffe8648ccb9cb0fb3f1e1b8bd` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:35.346500 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa057f-1bd0-45fe-b59c-6ce9beaf4bf3 None admin] RBAC: Authorizing `identity:get_project(project_id=2002e6bffe8648ccb9cb0fb3f1e1b8bd)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:35.347964 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa057f-1bd0-45fe-b59c-6ce9beaf4bf3 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:35.349857 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 70/134] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:25:35 2022] GET /identity/v3/projects/2002e6bffe8648ccb9cb0fb3f1e1b8bd => generated 312 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:35.356701 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa057f-1bd0-45fe-b59c-6ce9beaf4bf3 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:35.409408 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f11cdf-c13c-46d9-84e1-27a7286ff81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:35.410070 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f11cdf-c13c-46d9-84e1-27a7286ff81a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:35.410360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f11cdf-c13c-46d9-84e1-27a7286ff81a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:35.410637 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f11cdf-c13c-46d9-84e1-27a7286ff81a None admin] PATH_INFO: `/v3/projects/3883b1b257924533a84cbc24a92ea6e1` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:35.411847 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f11cdf-c13c-46d9-84e1-27a7286ff81a None admin] RBAC: Authorizing `identity:get_project(project_id=3883b1b257924533a84cbc24a92ea6e1)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:35.413380 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f11cdf-c13c-46d9-84e1-27a7286ff81a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:35.415768 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 65/135] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:25:35 2022] GET /identity/v3/projects/3883b1b257924533a84cbc24a92ea6e1 => generated 298 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:35.421328 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f11cdf-c13c-46d9-84e1-27a7286ff81a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:35.470723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa057f-1bd0-45fe-b59c-6ce9beaf4bf3 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:35.496416 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:35.508246 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1e4a8-7364-4447-a1b5-b9adf4b3576b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:35.509752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1e4a8-7364-4447-a1b5-b9adf4b3576b None admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:35.510046 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1e4a8-7364-4447-a1b5-b9adf4b3576b None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:35.511548 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1e4a8-7364-4447-a1b5-b9adf4b3576b None admin] PATH_INFO: `/v3/projects/2002e6bffe8648ccb9cb0fb3f1e1b8bd/users/380073b53b464cf9968503ff9be682ba/roles/028945f544094c26933c8ef60a480e9a` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:35.512603 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b1e4a8-7364-4447-a1b5-b9adf4b3576b None admin] RBAC: Authorizing `identity:create_grant(project_id=2002e6bffe8648ccb9cb0fb3f1e1b8bd, user_id=380073b53b464cf9968503ff9be682ba, role_id=028945f544094c26933c8ef60a480e9a)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:35.514102 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b1e4a8-7364-4447-a1b5-b9adf4b3576b None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:35.600117 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 71/136] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 22 20:25:35 2022] PUT /identity/v3/projects/2002e6bffe8648ccb9cb0fb3f1e1b8bd/users/380073b53b464cf9968503ff9be682ba/roles/028945f544094c26933c8ef60a480e9a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:25:35.621343 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f11cdf-c13c-46d9-84e1-27a7286ff81a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:35.668180 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9eeef-723f-468d-a24d-001ef1d157d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:35.669229 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9eeef-723f-468d-a24d-001ef1d157d8 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:35.669705 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9eeef-723f-468d-a24d-001ef1d157d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:35.670167 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9eeef-723f-468d-a24d-001ef1d157d8 None admin] PATH_INFO: `/v3/projects/3883b1b257924533a84cbc24a92ea6e1/users/380073b53b464cf9968503ff9be682ba/roles/7f4b8cdb739c4f808ef31961eb11510e` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:35.672679 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9eeef-723f-468d-a24d-001ef1d157d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=3883b1b257924533a84cbc24a92ea6e1, user_id=380073b53b464cf9968503ff9be682ba, role_id=7f4b8cdb739c4f808ef31961eb11510e)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:35.674380 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af9eeef-723f-468d-a24d-001ef1d157d8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:35.784323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 66/137] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 22 20:25:35 2022] PUT /identity/v3/projects/3883b1b257924533a84cbc24a92ea6e1/users/380073b53b464cf9968503ff9be682ba/roles/7f4b8cdb739c4f808ef31961eb11510e => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:25:36.184777 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f2bdf-f5e7-492b-a09d-cca49ff3b9b3 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:36.185312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f2bdf-f5e7-492b-a09d-cca49ff3b9b3 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:36.185312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f2bdf-f5e7-492b-a09d-cca49ff3b9b3 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:36.186650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 72/138] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:36.193450 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab43a2-b242-48ba-8a57-c2d773ffbb1a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:36.193858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab43a2-b242-48ba-8a57-c2d773ffbb1a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:36.194025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab43a2-b242-48ba-8a57-c2d773ffbb1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:36.217533 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-86ab43a2-b242-48ba-8a57-c2d773ffbb1a None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:36.218727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-86ab43a2-b242-48ba-8a57-c2d773ffbb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:36.252193 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:36.286984 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c5be8-aecd-4a6d-9c77-6d842fddeda9 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:36.287269 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c5be8-aecd-4a6d-9c77-6d842fddeda9 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:36.287550 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c5be8-aecd-4a6d-9c77-6d842fddeda9 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:36.292757 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 73/139] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:25:36.294916 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d9a76-f48e-4d85-8b90-a946db9e47e4 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:36.295199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d9a76-f48e-4d85-8b90-a946db9e47e4 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:36.295492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d9a76-f48e-4d85-8b90-a946db9e47e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:36.303159 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 67/140] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:25:36.338218 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-850d9a76-f48e-4d85-8b90-a946db9e47e4 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:36.339483 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-850d9a76-f48e-4d85-8b90-a946db9e47e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:36.447152 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 74/141] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:25:36.664090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab43a2-b242-48ba-8a57-c2d773ffbb1a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:36.784228 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d9a76-f48e-4d85-8b90-a946db9e47e4 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:36.784789 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab43a2-b242-48ba-8a57-c2d773ffbb1a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:36.842041 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7ec90-b9b6-4082-a913-dbce31410fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:36.843040 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7ec90-b9b6-4082-a913-dbce31410fad None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:36.843331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7ec90-b9b6-4082-a913-dbce31410fad None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:36.843747 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7ec90-b9b6-4082-a913-dbce31410fad None admin] PATH_INFO: `/v3/domains/default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:36.845150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7ec90-b9b6-4082-a913-dbce31410fad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:36.846624 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d7ec90-b9b6-4082-a913-dbce31410fad None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:36.848503 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 68/142] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:25:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:36.854880 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7ec90-b9b6-4082-a913-dbce31410fad None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:36.910166 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:36.977258 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d9a76-f48e-4d85-8b90-a946db9e47e4 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:36.997019 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:37.032046 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f50989-c8ed-4315-92c1-43926b3212bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:37.032703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f50989-c8ed-4315-92c1-43926b3212bb None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:37.032984 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f50989-c8ed-4315-92c1-43926b3212bb None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:37.033250 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f50989-c8ed-4315-92c1-43926b3212bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:37.054173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f50989-c8ed-4315-92c1-43926b3212bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:25:37.059114 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-a7f50989-c8ed-4315-92c1-43926b3212bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:25:37.059114 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:25:37.059114 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:25:37.059114 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:25:37.059114 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:25:37.059114 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:25:37.059114 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:25:37.059114 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:25:37.059114 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:25:37.059114 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:25:37.059114 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:25:37.059114 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:25:37.059114 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:25:37.059114 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:25:37.059114 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:25:37.059114 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:25:37.060090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:25:37.060090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:25:37.060090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:25:37.060090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:25:37.060090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:25:37.060090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:25:37.060090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:25:37.060090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:25:37.060090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:25:37.060090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:25:37.060090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:25:37.060090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:25:37.060090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:25:37.060090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:25:37.060090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:25:37.060090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:25:37.060861 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:25:37.060861 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:25:37.060861 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:25:37.060861 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:25:37.060861 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:25:37.060861 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:25:37.060861 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:25:37.060861 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:25:37.060861 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:25:37.060861 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:25:37.060861 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:25:37.060861 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:25:37.060861 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 75/143] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:25:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:25:37.067483 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f50989-c8ed-4315-92c1-43926b3212bb None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:37.098889 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7ec90-b9b6-4082-a913-dbce31410fad None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:37.213942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35826e47-8160-4785-8e4e-d6efbc8bc0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:37.214557 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35826e47-8160-4785-8e4e-d6efbc8bc0ed None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:37.214845 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35826e47-8160-4785-8e4e-d6efbc8bc0ed None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:37.215123 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35826e47-8160-4785-8e4e-d6efbc8bc0ed None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:37.215786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35826e47-8160-4785-8e4e-d6efbc8bc0ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:37.217421 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35826e47-8160-4785-8e4e-d6efbc8bc0ed None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:37.235281 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f50989-c8ed-4315-92c1-43926b3212bb None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:37.275880 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d5ddf-7a26-43ce-a2d2-80f1380ac882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:37.276643 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d5ddf-7a26-43ce-a2d2-80f1380ac882 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:37.277013 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d5ddf-7a26-43ce-a2d2-80f1380ac882 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:37.277353 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d5ddf-7a26-43ce-a2d2-80f1380ac882 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:37.278164 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d5ddf-7a26-43ce-a2d2-80f1380ac882 None admin] RBAC: Adding query filter params (name=member) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:37.278542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d5ddf-7a26-43ce-a2d2-80f1380ac882 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:37.280107 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d5ddf-7a26-43ce-a2d2-80f1380ac882 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:37.289474 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 76/144] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 22 20:25:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:37.296796 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d5ddf-7a26-43ce-a2d2-80f1380ac882 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:37.344951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:37.359520 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 69/145] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Aug 22 20:25:36 2022] POST /identity/v3/users => generated 283 bytes in 505 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:25:37.450388 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d5ddf-7a26-43ce-a2d2-80f1380ac882 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:37.510945 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82ef51-b61a-4f9f-b9b5-65d59f467be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:37.511665 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82ef51-b61a-4f9f-b9b5-65d59f467be6 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:37.511948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82ef51-b61a-4f9f-b9b5-65d59f467be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:37.512227 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82ef51-b61a-4f9f-b9b5-65d59f467be6 None admin] PATH_INFO: `/v3/users/380073b53b464cf9968503ff9be682ba` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:37.513472 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82ef51-b61a-4f9f-b9b5-65d59f467be6 None admin] RBAC: Authorizing `identity:get_user(user_id=380073b53b464cf9968503ff9be682ba)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:37.514967 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82ef51-b61a-4f9f-b9b5-65d59f467be6 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:37.516627 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 77/146] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:25:37 2022] GET /identity/v3/users/380073b53b464cf9968503ff9be682ba => generated 275 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:37.522587 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35826e47-8160-4785-8e4e-d6efbc8bc0ed None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:37.653111 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:37.670286 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35826e47-8160-4785-8e4e-d6efbc8bc0ed None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:37.707652 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c340d-6085-4741-bd15-c6dd9658ee83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:37.708618 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c340d-6085-4741-bd15-c6dd9658ee83 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:37.709130 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c340d-6085-4741-bd15-c6dd9658ee83 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:37.709691 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c340d-6085-4741-bd15-c6dd9658ee83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:37.815661 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c340d-6085-4741-bd15-c6dd9658ee83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:37.817525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c340d-6085-4741-bd15-c6dd9658ee83 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:37.919872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:37.940778 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 70/147] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:25:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:25:37.946679 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82ef51-b61a-4f9f-b9b5-65d59f467be6 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:37.986664 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed95e0c-4056-430d-8331-b47e47c0836c None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:37.986967 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed95e0c-4056-430d-8331-b47e47c0836c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:37.987221 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed95e0c-4056-430d-8331-b47e47c0836c None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:37.988729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 71/148] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:25:37.994585 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f14c0-6108-4383-96db-4ab61e84a8e3 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:37.994876 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f14c0-6108-4383-96db-4ab61e84a8e3 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:37.995146 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f14c0-6108-4383-96db-4ab61e84a8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:38.016904 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-517f14c0-6108-4383-96db-4ab61e84a8e3 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:38.018110 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-517f14c0-6108-4383-96db-4ab61e84a8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:38.096240 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 72/149] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:25:38.147031 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82ef51-b61a-4f9f-b9b5-65d59f467be6 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:38.148986 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:38.205065 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946c18a-ec47-4ef5-8af1-489e52d296b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:38.205625 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946c18a-ec47-4ef5-8af1-489e52d296b9 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:38.205910 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946c18a-ec47-4ef5-8af1-489e52d296b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:38.206182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946c18a-ec47-4ef5-8af1-489e52d296b9 None admin] PATH_INFO: `/v3/projects/3883b1b257924533a84cbc24a92ea6e1` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:38.213445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946c18a-ec47-4ef5-8af1-489e52d296b9 None admin] RBAC: Authorizing `identity:get_project(project_id=3883b1b257924533a84cbc24a92ea6e1)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:38.214937 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946c18a-ec47-4ef5-8af1-489e52d296b9 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:38.216833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 78/150] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:25:37 2022] GET /identity/v3/projects/3883b1b257924533a84cbc24a92ea6e1 => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:38.221335 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c89f0-0574-4fef-945c-e74de8a1c121 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:38.221807 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c89f0-0574-4fef-945c-e74de8a1c121 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:38.221900 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c89f0-0574-4fef-945c-e74de8a1c121 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:38.223424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 73/151] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:38.226513 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946c18a-ec47-4ef5-8af1-489e52d296b9 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:38.229262 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a86c4-ae4c-4d8d-b301-0ecd73ddc503 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:38.229556 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a86c4-ae4c-4d8d-b301-0ecd73ddc503 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:38.229834 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a86c4-ae4c-4d8d-b301-0ecd73ddc503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:38.269877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-db0a86c4-ae4c-4d8d-b301-0ecd73ddc503 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:38.271094 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-db0a86c4-ae4c-4d8d-b301-0ecd73ddc503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:38.372935 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946c18a-ec47-4ef5-8af1-489e52d296b9 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:38.389347 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 74/152] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:25:38.417972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e380cb-a9b0-4003-9402-20173c219aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:38.418583 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e380cb-a9b0-4003-9402-20173c219aae None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:38.418869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e380cb-a9b0-4003-9402-20173c219aae None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:38.419247 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e380cb-a9b0-4003-9402-20173c219aae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:38.420018 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e380cb-a9b0-4003-9402-20173c219aae None admin] RBAC: Adding query filter params (role.id=028945f544094c26933c8ef60a480e9a, scope.project.id=3883b1b257924533a84cbc24a92ea6e1, user.id=380073b53b464cf9968503ff9be682ba) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:38.420349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e380cb-a9b0-4003-9402-20173c219aae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:38.421869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e380cb-a9b0-4003-9402-20173c219aae None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:38.428511 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 79/153] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:25:38 2022] GET /identity/v3/role_assignments?user.id=380073b53b464cf9968503ff9be682ba&scope.project.id=3883b1b257924533a84cbc24a92ea6e1&role.id=028945f544094c26933c8ef60a480e9a => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:38.613764 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a86c4-ae4c-4d8d-b301-0ecd73ddc503 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:38.672440 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f012b5-ff5e-4a5b-8dc9-ccd84c70cd01 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:38.672783 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f012b5-ff5e-4a5b-8dc9-ccd84c70cd01 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:38.673025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f012b5-ff5e-4a5b-8dc9-ccd84c70cd01 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:38.674492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 80/154] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:25:38.679832 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:38.681162 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08425ef9-0765-4de0-8223-8be4ccf68608 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:38.681538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08425ef9-0765-4de0-8223-8be4ccf68608 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:38.681833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08425ef9-0765-4de0-8223-8be4ccf68608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:38.713628 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-08425ef9-0765-4de0-8223-8be4ccf68608 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:38.714855 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-08425ef9-0765-4de0-8223-8be4ccf68608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:38.780797 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:38.815191 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a86c4-ae4c-4d8d-b301-0ecd73ddc503 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:38.839749 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 81/155] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:25:38.840584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08425ef9-0765-4de0-8223-8be4ccf68608 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:38.871158 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2b3e2-a39a-402e-95a0-67c3fb2a24bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:38.871739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2b3e2-a39a-402e-95a0-67c3fb2a24bc None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:38.872304 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2b3e2-a39a-402e-95a0-67c3fb2a24bc None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:38.872592 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2b3e2-a39a-402e-95a0-67c3fb2a24bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:38.896035 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d2b3e2-a39a-402e-95a0-67c3fb2a24bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:25:38.900925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-13d2b3e2-a39a-402e-95a0-67c3fb2a24bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:25:38.900925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:25:38.900925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:25:38.900925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:25:38.900925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:25:38.900925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:25:38.900925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:25:38.900925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:25:38.900925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:25:38.900925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:25:38.900925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:25:38.900925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:25:38.900925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:25:38.900925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:25:38.900925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:25:38.900925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:25:38.901775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:25:38.901775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:25:38.901775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:25:38.901775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:25:38.901775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:25:38.901775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:25:38.901775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:25:38.901775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:25:38.901775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:25:38.901775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:25:38.901775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:25:38.901775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:25:38.901775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:25:38.901775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:25:38.901775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:25:38.901775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:25:38.902938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:25:38.902938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:25:38.902938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:25:38.902938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:25:38.902938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:25:38.902938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:25:38.902938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:25:38.902938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:25:38.902938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:25:38.902938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:25:38.902938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:25:38.902938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:25:38.902938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 75/156] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 22 20:25:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:25:38.903712 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f625b-ba51-4f97-bbf5-865af7f9f283 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:38.903712 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f625b-ba51-4f97-bbf5-865af7f9f283 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:38.903833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f625b-ba51-4f97-bbf5-865af7f9f283 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:38.905739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 76/157] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:38.911345 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3d184-dd76-46bb-8679-3a36af92f863 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:38.911671 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3d184-dd76-46bb-8679-3a36af92f863 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:38.911942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3d184-dd76-46bb-8679-3a36af92f863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:38.935552 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-29d3d184-dd76-46bb-8679-3a36af92f863 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:38.936770 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-29d3d184-dd76-46bb-8679-3a36af92f863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:39.013747 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 77/158] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:25:39.014442 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d3d184-dd76-46bb-8679-3a36af92f863 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:39.034825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08425ef9-0765-4de0-8223-8be4ccf68608 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:39.051249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:39.117395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271db634-4ee5-4a12-9845-febf6eb70a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:39.119493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271db634-4ee5-4a12-9845-febf6eb70a97 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:39.119779 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271db634-4ee5-4a12-9845-febf6eb70a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:39.120052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271db634-4ee5-4a12-9845-febf6eb70a97 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:39.121503 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d3d184-dd76-46bb-8679-3a36af92f863 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:39.138806 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271db634-4ee5-4a12-9845-febf6eb70a97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:25:39.150952 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-271db634-4ee5-4a12-9845-febf6eb70a97 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:25:39.150952 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:25:39.150952 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:25:39.150952 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:25:39.150952 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:25:39.150952 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:25:39.150952 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:25:39.150952 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:25:39.150952 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:25:39.150952 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:25:39.150952 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:25:39.150952 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:25:39.150952 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:25:39.150952 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:25:39.150952 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:25:39.150952 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:25:39.151886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:25:39.151886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:25:39.151886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:25:39.151886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:25:39.151886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:25:39.151886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:25:39.151886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:25:39.151886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:25:39.151886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:25:39.151886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:25:39.151886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:25:39.151886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:25:39.151886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:25:39.151886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:25:39.151886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:25:39.151886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:25:39.153090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:25:39.153090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:25:39.153090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:25:39.153090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:25:39.153090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:25:39.153090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:25:39.153090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:25:39.153090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:25:39.153090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:25:39.153090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:25:39.153090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:25:39.153090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:25:39.153090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 82/159] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:25:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:25:39.162550 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271db634-4ee5-4a12-9845-febf6eb70a97 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:39.166019 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87599d-e9a2-4ccd-a669-941946c2cdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:39.166683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87599d-e9a2-4ccd-a669-941946c2cdbe None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:39.166960 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87599d-e9a2-4ccd-a669-941946c2cdbe None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:39.167230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87599d-e9a2-4ccd-a669-941946c2cdbe None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:39.167906 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e87599d-e9a2-4ccd-a669-941946c2cdbe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:39.168203 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e87599d-e9a2-4ccd-a669-941946c2cdbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:39.169665 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e87599d-e9a2-4ccd-a669-941946c2cdbe None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:39.182758 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 78/160] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:25:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:39.201942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87599d-e9a2-4ccd-a669-941946c2cdbe None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:39.204782 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:39.297411 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271db634-4ee5-4a12-9845-febf6eb70a97 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:39.341412 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4d121-6b67-4b5c-ad15-46754226efe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:39.342035 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4d121-6b67-4b5c-ad15-46754226efe5 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:39.342312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4d121-6b67-4b5c-ad15-46754226efe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:39.342583 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4d121-6b67-4b5c-ad15-46754226efe5 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:39.343259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4d121-6b67-4b5c-ad15-46754226efe5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:39.343559 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4d121-6b67-4b5c-ad15-46754226efe5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:39.345064 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4d121-6b67-4b5c-ad15-46754226efe5 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:39.354868 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 83/161] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 22 20:25:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:39.355698 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4d121-6b67-4b5c-ad15-46754226efe5 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:39.461015 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:39.468949 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87599d-e9a2-4ccd-a669-941946c2cdbe None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:39.472802 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:39.489457 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4d121-6b67-4b5c-ad15-46754226efe5 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:39.536595 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518148c-8ce4-40f8-b929-21cd01f5fcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:39.537897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518148c-8ce4-40f8-b929-21cd01f5fcb6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:39.538179 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518148c-8ce4-40f8-b929-21cd01f5fcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:39.538453 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518148c-8ce4-40f8-b929-21cd01f5fcb6 None admin] PATH_INFO: `/v3/users/1d89af55e2b04afa9fa5ae15b3027c4e` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:39.541005 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518148c-8ce4-40f8-b929-21cd01f5fcb6 None admin] RBAC: Authorizing `identity:get_user(user_id=1d89af55e2b04afa9fa5ae15b3027c4e)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:39.541923 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7077713-23a8-47fa-b0d5-558177a3e497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:39.542565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7077713-23a8-47fa-b0d5-558177a3e497 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:39.542844 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7077713-23a8-47fa-b0d5-558177a3e497 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:39.543115 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7077713-23a8-47fa-b0d5-558177a3e497 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:39.544902 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518148c-8ce4-40f8-b929-21cd01f5fcb6 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:39.546735 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 79/162] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:25:39 2022] GET /identity/v3/users/1d89af55e2b04afa9fa5ae15b3027c4e => generated 247 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:25:39.547286 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518148c-8ce4-40f8-b929-21cd01f5fcb6 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:39.567846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7077713-23a8-47fa-b0d5-558177a3e497 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:25:39.573287 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-d7077713-23a8-47fa-b0d5-558177a3e497 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:25:39.573287 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:25:39.573287 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:25:39.573287 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:25:39.573287 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:25:39.573287 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:25:39.573287 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:25:39.573287 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:25:39.573287 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:25:39.573287 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:25:39.573287 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:25:39.573287 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:25:39.573287 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:25:39.573287 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:25:39.573287 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:25:39.573287 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:25:39.576614 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:25:39.576614 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:25:39.576614 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:25:39.576614 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:25:39.576614 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:25:39.576614 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:25:39.576614 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:25:39.576614 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:25:39.576614 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:25:39.576614 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:25:39.576614 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:25:39.576614 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:25:39.576614 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:25:39.576614 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:25:39.576614 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:25:39.576614 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:25:39.577397 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:25:39.577397 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:25:39.577397 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:25:39.577397 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:25:39.577397 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:25:39.577397 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:25:39.577397 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:25:39.577397 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:25:39.577397 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:25:39.577397 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:25:39.577397 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:25:39.577397 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:25:39.577397 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 84/163] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 22 20:25:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:25:39.578010 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7077713-23a8-47fa-b0d5-558177a3e497 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:39.727408 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518148c-8ce4-40f8-b929-21cd01f5fcb6 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:39.765319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7077713-23a8-47fa-b0d5-558177a3e497 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:39.791218 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac070513-0d6e-4b71-bae4-b94d163623d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:39.791881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac070513-0d6e-4b71-bae4-b94d163623d1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:39.792162 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac070513-0d6e-4b71-bae4-b94d163623d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:39.792438 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac070513-0d6e-4b71-bae4-b94d163623d1 None admin] PATH_INFO: `/v3/users/41d69b9a30df40f8ad2c9b4ef7d636a4` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:39.794949 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac070513-0d6e-4b71-bae4-b94d163623d1 None admin] RBAC: Authorizing `identity:get_user(user_id=41d69b9a30df40f8ad2c9b4ef7d636a4)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:39.795961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac070513-0d6e-4b71-bae4-b94d163623d1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:39.799199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 80/164] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:25:39 2022] GET /identity/v3/users/41d69b9a30df40f8ad2c9b4ef7d636a4 => generated 289 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:39.801263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac070513-0d6e-4b71-bae4-b94d163623d1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:39.830829 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636140d-65fa-445b-b87c-eab459c763e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:39.831759 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636140d-65fa-445b-b87c-eab459c763e1 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:39.832039 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636140d-65fa-445b-b87c-eab459c763e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:39.832312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636140d-65fa-445b-b87c-eab459c763e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:39.851326 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636140d-65fa-445b-b87c-eab459c763e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:25:39.859727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-9636140d-65fa-445b-b87c-eab459c763e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:25:39.859727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:25:39.859727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:25:39.859727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:25:39.859727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:25:39.859727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:25:39.859727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:25:39.859727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:25:39.859727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:25:39.859727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:25:39.859727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:25:39.859727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:25:39.859727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:25:39.859727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:25:39.859727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:25:39.859727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:25:39.860775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:25:39.860775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:25:39.860775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:25:39.860775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:25:39.860775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:25:39.860775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:25:39.860775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:25:39.860775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:25:39.860775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:25:39.860775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:25:39.860775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:25:39.860775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:25:39.860775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:25:39.860775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:25:39.860775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:25:39.860775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:25:39.861554 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:25:39.861554 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:25:39.861554 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:25:39.861554 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:25:39.861554 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:25:39.861554 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:25:39.861554 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:25:39.861554 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:25:39.861554 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:25:39.861554 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:25:39.861554 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:25:39.861554 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:25:39.861554 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 85/165] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:25:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:25:39.862848 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636140d-65fa-445b-b87c-eab459c763e1 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:39.878055 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:39.884247 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:39.981624 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac070513-0d6e-4b71-bae4-b94d163623d1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:40.043109 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bffa20-1a72-4903-befa-2543bdcd1189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:40.043728 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bffa20-1a72-4903-befa-2543bdcd1189 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:40.044012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bffa20-1a72-4903-befa-2543bdcd1189 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:40.044285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bffa20-1a72-4903-befa-2543bdcd1189 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:40.050708 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636140d-65fa-445b-b87c-eab459c763e1 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:40.113901 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0f5ad-1204-4a7e-97d6-90db846216d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:40.114512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0f5ad-1204-4a7e-97d6-90db846216d7 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:40.114795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0f5ad-1204-4a7e-97d6-90db846216d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:40.115069 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0f5ad-1204-4a7e-97d6-90db846216d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:40.115738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0f5ad-1204-4a7e-97d6-90db846216d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:40.116044 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0f5ad-1204-4a7e-97d6-90db846216d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:40.118861 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0f5ad-1204-4a7e-97d6-90db846216d7 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:40.131645 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 86/166] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:25:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:40.133644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0f5ad-1204-4a7e-97d6-90db846216d7 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:40.171254 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bffa20-1a72-4903-befa-2543bdcd1189 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:40.173087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bffa20-1a72-4903-befa-2543bdcd1189 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:40.220341 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:40.245214 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:40.295536 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0f5ad-1204-4a7e-97d6-90db846216d7 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:40.342547 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 81/167] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:25:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:25:40.343425 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bffa20-1a72-4903-befa-2543bdcd1189 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:40.361346 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2e4a9-b870-4562-9b60-6e6c0e5f0388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:40.361988 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2e4a9-b870-4562-9b60-6e6c0e5f0388 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:40.362268 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2e4a9-b870-4562-9b60-6e6c0e5f0388 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:40.362543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2e4a9-b870-4562-9b60-6e6c0e5f0388 None admin] PATH_INFO: `/v3/projects/3883b1b257924533a84cbc24a92ea6e1` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:40.365155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2e4a9-b870-4562-9b60-6e6c0e5f0388 None admin] RBAC: Authorizing `identity:get_project(project_id=3883b1b257924533a84cbc24a92ea6e1)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:40.366622 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2e4a9-b870-4562-9b60-6e6c0e5f0388 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:40.369050 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 87/168] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:25:40 2022] GET /identity/v3/projects/3883b1b257924533a84cbc24a92ea6e1 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:40.369608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2e4a9-b870-4562-9b60-6e6c0e5f0388 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:40.529838 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bffa20-1a72-4903-befa-2543bdcd1189 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:40.565911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2e4a9-b870-4562-9b60-6e6c0e5f0388 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:40.581518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09d0a6-efe6-445f-a493-39e8b16282d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:40.582518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09d0a6-efe6-445f-a493-39e8b16282d8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:40.583135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09d0a6-efe6-445f-a493-39e8b16282d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:40.583593 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09d0a6-efe6-445f-a493-39e8b16282d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:40.584448 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09d0a6-efe6-445f-a493-39e8b16282d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:40.587093 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09d0a6-efe6-445f-a493-39e8b16282d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:40.601567 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09d0a6-efe6-445f-a493-39e8b16282d8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:40.608068 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:40.622551 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 82/169] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 22 20:25:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:40.623825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09d0a6-efe6-445f-a493-39e8b16282d8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:40.641166 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53e57d-2a16-4670-829b-c0e7eaef3584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:40.641852 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53e57d-2a16-4670-829b-c0e7eaef3584 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:40.642104 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53e57d-2a16-4670-829b-c0e7eaef3584 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:40.642382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53e57d-2a16-4670-829b-c0e7eaef3584 None admin] PATH_INFO: `/v3/users/380073b53b464cf9968503ff9be682ba` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:40.643625 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53e57d-2a16-4670-829b-c0e7eaef3584 None admin] RBAC: Authorizing `identity:get_user(user_id=380073b53b464cf9968503ff9be682ba)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:40.645818 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53e57d-2a16-4670-829b-c0e7eaef3584 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:40.655175 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 88/170] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:25:40 2022] GET /identity/v3/users/380073b53b464cf9968503ff9be682ba => generated 275 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:40.656301 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53e57d-2a16-4670-829b-c0e7eaef3584 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:40.664651 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:40.789558 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53e57d-2a16-4670-829b-c0e7eaef3584 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:40.817447 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09d0a6-efe6-445f-a493-39e8b16282d8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:40.826447 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22851de-4c07-4421-bbdf-64833efe2c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:40.827113 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22851de-4c07-4421-bbdf-64833efe2c0e None admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:40.827391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22851de-4c07-4421-bbdf-64833efe2c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:40.827662 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22851de-4c07-4421-bbdf-64833efe2c0e None admin] PATH_INFO: `/v3/projects/3883b1b257924533a84cbc24a92ea6e1/users/41d69b9a30df40f8ad2c9b4ef7d636a4/roles/c1ddd6c095d041d4a18c8cf126582891` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:40.829703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22851de-4c07-4421-bbdf-64833efe2c0e None admin] RBAC: Authorizing `identity:create_grant(project_id=3883b1b257924533a84cbc24a92ea6e1, user_id=41d69b9a30df40f8ad2c9b4ef7d636a4, role_id=c1ddd6c095d041d4a18c8cf126582891)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:40.831714 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22851de-4c07-4421-bbdf-64833efe2c0e None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:40.854921 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccae42a-99d9-484a-ae0e-1c95fd3f991d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:40.855646 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccae42a-99d9-484a-ae0e-1c95fd3f991d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:40.855994 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccae42a-99d9-484a-ae0e-1c95fd3f991d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:40.856328 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccae42a-99d9-484a-ae0e-1c95fd3f991d None admin] PATH_INFO: `/v3/projects/3883b1b257924533a84cbc24a92ea6e1` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:40.857543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccae42a-99d9-484a-ae0e-1c95fd3f991d None admin] RBAC: Authorizing `identity:get_project(project_id=3883b1b257924533a84cbc24a92ea6e1)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:40.859097 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccae42a-99d9-484a-ae0e-1c95fd3f991d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:40.860791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 83/171] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:25:40 2022] GET /identity/v3/projects/3883b1b257924533a84cbc24a92ea6e1 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:40.861750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccae42a-99d9-484a-ae0e-1c95fd3f991d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:40.906023 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 89/172] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 22 20:25:40 2022] PUT /identity/v3/projects/3883b1b257924533a84cbc24a92ea6e1/users/41d69b9a30df40f8ad2c9b4ef7d636a4/roles/c1ddd6c095d041d4a18c8cf126582891 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:25:40.907487 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22851de-4c07-4421-bbdf-64833efe2c0e None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:40.940431 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:40.984612 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccae42a-99d9-484a-ae0e-1c95fd3f991d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:41.023776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b794ba2-16b4-4dbf-8d52-319bd8250ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:41.024952 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b794ba2-16b4-4dbf-8d52-319bd8250ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:41.025112 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:41.025255 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b794ba2-16b4-4dbf-8d52-319bd8250ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:41.025741 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b794ba2-16b4-4dbf-8d52-319bd8250ca4 None admin] PATH_INFO: `/v3/users/380073b53b464cf9968503ff9be682ba` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:41.027010 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b794ba2-16b4-4dbf-8d52-319bd8250ca4 None admin] RBAC: Authorizing `identity:get_user(user_id=380073b53b464cf9968503ff9be682ba)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:41.028579 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b794ba2-16b4-4dbf-8d52-319bd8250ca4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:41.030567 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 84/173] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:25:40 2022] GET /identity/v3/users/380073b53b464cf9968503ff9be682ba => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:41.050660 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134f394-7ee1-4be7-a9d8-7759c69834a6 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:41.050660 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134f394-7ee1-4be7-a9d8-7759c69834a6 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:41.050660 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134f394-7ee1-4be7-a9d8-7759c69834a6 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:41.050660 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 85/174] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:41.050660 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134f394-7ee1-4be7-a9d8-7759c69834a6 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:41.059917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22851de-4c07-4421-bbdf-64833efe2c0e None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:41.112232 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05be18-6582-4dcd-a909-ca02a6ab9ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:41.113242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05be18-6582-4dcd-a909-ca02a6ab9ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:41.113713 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05be18-6582-4dcd-a909-ca02a6ab9ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:41.114174 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05be18-6582-4dcd-a909-ca02a6ab9ac8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:41.195770 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af05be18-6582-4dcd-a909-ca02a6ab9ac8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:41.198708 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af05be18-6582-4dcd-a909-ca02a6ab9ac8 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:41.201326 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134f394-7ee1-4be7-a9d8-7759c69834a6 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:41.234574 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:41.240129 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b949a6-8b36-4c7d-9a47-af49612a0d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:41.240770 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b949a6-8b36-4c7d-9a47-af49612a0d04 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:41.241051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b949a6-8b36-4c7d-9a47-af49612a0d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:41.241329 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b949a6-8b36-4c7d-9a47-af49612a0d04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:41.242041 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b949a6-8b36-4c7d-9a47-af49612a0d04 None admin] RBAC: Adding query filter params (role.id=e3faa0474c054da6bb4d8910a4e40bff, scope.project.id=3883b1b257924533a84cbc24a92ea6e1, user.id=1d89af55e2b04afa9fa5ae15b3027c4e) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:41.242348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b949a6-8b36-4c7d-9a47-af49612a0d04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:41.246344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b949a6-8b36-4c7d-9a47-af49612a0d04 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:41.256695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 86/175] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:25:41 2022] GET /identity/v3/role_assignments?user.id=1d89af55e2b04afa9fa5ae15b3027c4e&scope.project.id=3883b1b257924533a84cbc24a92ea6e1&role.id=e3faa0474c054da6bb4d8910a4e40bff => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:41.256695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b949a6-8b36-4c7d-9a47-af49612a0d04 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:41.300772 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:41.336446 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 90/176] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:25:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:25:41.342541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e34c2-1183-4340-b75e-748c00c6bf79 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:41.343024 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e34c2-1183-4340-b75e-748c00c6bf79 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:41.343483 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e34c2-1183-4340-b75e-748c00c6bf79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:41.369972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-974e34c2-1183-4340-b75e-748c00c6bf79 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:41.371419 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-974e34c2-1183-4340-b75e-748c00c6bf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:41.375617 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b949a6-8b36-4c7d-9a47-af49612a0d04 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:41.414192 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da4a89-fb4d-44ea-b3cc-e3e3101ce200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:41.416269 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da4a89-fb4d-44ea-b3cc-e3e3101ce200 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:41.416650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da4a89-fb4d-44ea-b3cc-e3e3101ce200 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:41.417050 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da4a89-fb4d-44ea-b3cc-e3e3101ce200 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:41.465940 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 91/177] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:25:41.467131 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e34c2-1183-4340-b75e-748c00c6bf79 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:41.489373 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:41.498375 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da4a89-fb4d-44ea-b3cc-e3e3101ce200 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:41.500052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da4a89-fb4d-44ea-b3cc-e3e3101ce200 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:41.576980 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e34c2-1183-4340-b75e-748c00c6bf79 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:41.581642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:41.615590 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a9ac1-0e0b-4673-8a94-61d6d0d4f152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:41.616450 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a9ac1-0e0b-4673-8a94-61d6d0d4f152 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:41.616886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a9ac1-0e0b-4673-8a94-61d6d0d4f152 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:41.617391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a9ac1-0e0b-4673-8a94-61d6d0d4f152 None admin] PATH_INFO: `/v3/projects/3883b1b257924533a84cbc24a92ea6e1` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:41.619227 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a9ac1-0e0b-4673-8a94-61d6d0d4f152 None admin] RBAC: Authorizing `identity:get_project(project_id=3883b1b257924533a84cbc24a92ea6e1)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:41.621041 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a9ac1-0e0b-4673-8a94-61d6d0d4f152 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:41.622818 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 92/178] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:25:41 2022] GET /identity/v3/projects/3883b1b257924533a84cbc24a92ea6e1 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:41.624419 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e0dbf-dbb9-46ac-99f8-3fc0ce34b0d4 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:41.624886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e0dbf-dbb9-46ac-99f8-3fc0ce34b0d4 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:41.625305 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e0dbf-dbb9-46ac-99f8-3fc0ce34b0d4 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:41.626891 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 87/179] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:25:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:25:41.627576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 93/180] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:41.628284 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68265c3c-038b-4ea0-97e8-3b0189163cd5 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:41.631786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68265c3c-038b-4ea0-97e8-3b0189163cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:41.631786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68265c3c-038b-4ea0-97e8-3b0189163cd5 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:41.631786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 88/181] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:41.632074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a99f59-1a19-4c95-84e8-ed5c25eda241 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:41.634769 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a99f59-1a19-4c95-84e8-ed5c25eda241 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:41.634769 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a99f59-1a19-4c95-84e8-ed5c25eda241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:41.636217 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5722b1-5457-423c-9cee-fbc070a14faa None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:41.636601 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5722b1-5457-423c-9cee-fbc070a14faa None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:41.636999 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5722b1-5457-423c-9cee-fbc070a14faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:41.660209 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-fe5722b1-5457-423c-9cee-fbc070a14faa None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:41.661420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-26a99f59-1a19-4c95-84e8-ed5c25eda241 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:41.661614 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-fe5722b1-5457-423c-9cee-fbc070a14faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:41.662722 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-26a99f59-1a19-4c95-84e8-ed5c25eda241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:41.742431 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 89/182] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:25:41.744029 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5722b1-5457-423c-9cee-fbc070a14faa None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:41.765009 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 94/183] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:25:41.765955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a99f59-1a19-4c95-84e8-ed5c25eda241 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:41.783756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:41.896093 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:41.907528 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a99f59-1a19-4c95-84e8-ed5c25eda241 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:41.942591 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f32d11-f5d8-4357-85f4-f3f5e77c812d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:41.943201 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f32d11-f5d8-4357-85f4-f3f5e77c812d None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:41.943476 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f32d11-f5d8-4357-85f4-f3f5e77c812d None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:41.943750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f32d11-f5d8-4357-85f4-f3f5e77c812d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:41.944839 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f32d11-f5d8-4357-85f4-f3f5e77c812d None admin] RBAC: Adding query filter params (role.id=7f4b8cdb739c4f808ef31961eb11510e, scope.project.id=3883b1b257924533a84cbc24a92ea6e1, user.id=380073b53b464cf9968503ff9be682ba) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:41.945295 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f32d11-f5d8-4357-85f4-f3f5e77c812d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:41.947408 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f32d11-f5d8-4357-85f4-f3f5e77c812d None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:41.953901 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 95/184] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:25:41 2022] GET /identity/v3/role_assignments?user.id=380073b53b464cf9968503ff9be682ba&scope.project.id=3883b1b257924533a84cbc24a92ea6e1&role.id=7f4b8cdb739c4f808ef31961eb11510e => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:41.954909 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f32d11-f5d8-4357-85f4-f3f5e77c812d None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:41.957414 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5722b1-5457-423c-9cee-fbc070a14faa None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:42.046787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d4060-854d-4b98-952b-4093a460cd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:42.047725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d4060-854d-4b98-952b-4093a460cd2c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:42.048237 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d4060-854d-4b98-952b-4093a460cd2c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:42.048691 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d4060-854d-4b98-952b-4093a460cd2c None admin] PATH_INFO: `/v3/projects/2002e6bffe8648ccb9cb0fb3f1e1b8bd` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:42.053567 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d4060-854d-4b98-952b-4093a460cd2c None admin] RBAC: Authorizing `identity:get_project(project_id=2002e6bffe8648ccb9cb0fb3f1e1b8bd)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:42.055403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d4060-854d-4b98-952b-4093a460cd2c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:42.057359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 90/185] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:25:41 2022] GET /identity/v3/projects/2002e6bffe8648ccb9cb0fb3f1e1b8bd => generated 312 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:42.063267 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d4060-854d-4b98-952b-4093a460cd2c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:42.067627 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f32d11-f5d8-4357-85f4-f3f5e77c812d None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:42.104497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5ee11-4498-4804-883e-11eb43d9a143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:42.105288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5ee11-4498-4804-883e-11eb43d9a143 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:42.105571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5ee11-4498-4804-883e-11eb43d9a143 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:42.105888 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5ee11-4498-4804-883e-11eb43d9a143 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:42.118048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5ee11-4498-4804-883e-11eb43d9a143 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:25:42.123395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-38e5ee11-4498-4804-883e-11eb43d9a143 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:25:42.123395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:25:42.123395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:25:42.123395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:25:42.123395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:25:42.123395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:25:42.123395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:25:42.123395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:25:42.123395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:25:42.123395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:25:42.123395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:25:42.123395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:25:42.123395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:25:42.123395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:25:42.123395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:25:42.123395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:25:42.124310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:25:42.124310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:25:42.124310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:25:42.124310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:25:42.124310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:25:42.124310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:25:42.124310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:25:42.124310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:25:42.124310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:25:42.124310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:25:42.124310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:25:42.124310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:25:42.124310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:25:42.124310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:25:42.124310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:25:42.124310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:25:42.125171 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:25:42.125171 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:25:42.125171 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:25:42.125171 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:25:42.125171 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:25:42.125171 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:25:42.125171 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:25:42.125171 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:25:42.125171 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:25:42.125171 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:25:42.125171 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:25:42.125171 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:25:42.125171 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 96/186] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 22 20:25:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:25:42.130462 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5ee11-4498-4804-883e-11eb43d9a143 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:42.231570 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:42.238909 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:42.247865 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d4060-854d-4b98-952b-4093a460cd2c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:42.287225 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940dba51-d93e-476e-8bdb-3f2fe31fc110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:42.288132 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940dba51-d93e-476e-8bdb-3f2fe31fc110 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:42.288406 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940dba51-d93e-476e-8bdb-3f2fe31fc110 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:42.288845 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940dba51-d93e-476e-8bdb-3f2fe31fc110 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:42.289904 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940dba51-d93e-476e-8bdb-3f2fe31fc110 None admin] RBAC: Adding query filter params (role.id=028945f544094c26933c8ef60a480e9a, scope.project.id=2002e6bffe8648ccb9cb0fb3f1e1b8bd, user.id=380073b53b464cf9968503ff9be682ba) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:42.290213 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940dba51-d93e-476e-8bdb-3f2fe31fc110 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:42.292017 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940dba51-d93e-476e-8bdb-3f2fe31fc110 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:42.292457 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5ee11-4498-4804-883e-11eb43d9a143 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:42.304438 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 91/187] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:25:42 2022] GET /identity/v3/role_assignments?user.id=380073b53b464cf9968503ff9be682ba&scope.project.id=2002e6bffe8648ccb9cb0fb3f1e1b8bd&role.id=028945f544094c26933c8ef60a480e9a => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:25:42.305930 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940dba51-d93e-476e-8bdb-3f2fe31fc110 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:42.351284 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca2c54-49be-4132-8ca9-3430b5119050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:42.352565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca2c54-49be-4132-8ca9-3430b5119050 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:42.353162 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca2c54-49be-4132-8ca9-3430b5119050 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:42.353523 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca2c54-49be-4132-8ca9-3430b5119050 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:42.354175 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca2c54-49be-4132-8ca9-3430b5119050 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:42.354544 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca2c54-49be-4132-8ca9-3430b5119050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:42.356609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca2c54-49be-4132-8ca9-3430b5119050 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:42.369172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 97/188] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:25:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:42.370138 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca2c54-49be-4132-8ca9-3430b5119050 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:42.450267 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940dba51-d93e-476e-8bdb-3f2fe31fc110 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:42.468418 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:42.501547 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca2c54-49be-4132-8ca9-3430b5119050 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:42.505534 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c909b-2cdb-4c4d-8c23-8cbf8d046cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:42.506411 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c909b-2cdb-4c4d-8c23-8cbf8d046cca None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:42.506871 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c909b-2cdb-4c4d-8c23-8cbf8d046cca None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:42.507311 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c909b-2cdb-4c4d-8c23-8cbf8d046cca None admin] PATH_INFO: `/v3/domains/default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:42.509252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c909b-2cdb-4c4d-8c23-8cbf8d046cca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:42.510917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c909b-2cdb-4c4d-8c23-8cbf8d046cca None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:42.512942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 92/189] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:25:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:42.513896 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c909b-2cdb-4c4d-8c23-8cbf8d046cca None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:42.541411 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db40e6a-5759-4c2c-a680-b9fb4310a969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:42.542384 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db40e6a-5759-4c2c-a680-b9fb4310a969 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:42.542662 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db40e6a-5759-4c2c-a680-b9fb4310a969 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:42.542925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db40e6a-5759-4c2c-a680-b9fb4310a969 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:42.549257 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:42.554928 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db40e6a-5759-4c2c-a680-b9fb4310a969 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:25:42.560939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-6db40e6a-5759-4c2c-a680-b9fb4310a969 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:25:42.560939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:25:42.560939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:25:42.560939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:25:42.560939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:25:42.560939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:25:42.560939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:25:42.560939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:25:42.560939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:25:42.560939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:25:42.560939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:25:42.560939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:25:42.560939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:25:42.560939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:25:42.560939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:25:42.560939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:25:42.561762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:25:42.561762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:25:42.561762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:25:42.561762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:25:42.561762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:25:42.561762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:25:42.561762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:25:42.561762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:25:42.561762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:25:42.561762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:25:42.561762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:25:42.561762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:25:42.561762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:25:42.561762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:25:42.561762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:25:42.561762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:25:42.562555 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:25:42.562555 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:25:42.562555 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:25:42.562555 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:25:42.562555 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:25:42.562555 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:25:42.562555 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:25:42.562555 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:25:42.562555 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:25:42.562555 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:25:42.562555 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:25:42.562555 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:25:42.562555 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 98/190] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 22 20:25:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:25:42.563238 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db40e6a-5759-4c2c-a680-b9fb4310a969 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:42.637882 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c909b-2cdb-4c4d-8c23-8cbf8d046cca None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:42.679888 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265d07a-f28d-45d4-914a-af0ea531e478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:42.680692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265d07a-f28d-45d4-914a-af0ea531e478 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:42.680968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265d07a-f28d-45d4-914a-af0ea531e478 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:42.681348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265d07a-f28d-45d4-914a-af0ea531e478 None admin] PATH_INFO: `/v3/users/fbd8426c4c9647ba87d731f863f22708` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:42.684888 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db40e6a-5759-4c2c-a680-b9fb4310a969 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:42.703832 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265d07a-f28d-45d4-914a-af0ea531e478 None admin] RBAC: Authorizing `identity:get_user(user_id=fbd8426c4c9647ba87d731f863f22708)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:42.705348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265d07a-f28d-45d4-914a-af0ea531e478 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:42.712229 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 93/191] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:25:42 2022] GET /identity/v3/users/fbd8426c4c9647ba87d731f863f22708 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:42.712229 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265d07a-f28d-45d4-914a-af0ea531e478 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:42.726891 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fe7ba-eb3a-465e-b185-85c77386a538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:42.727573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fe7ba-eb3a-465e-b185-85c77386a538 None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:42.727855 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fe7ba-eb3a-465e-b185-85c77386a538 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:42.728128 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fe7ba-eb3a-465e-b185-85c77386a538 None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:42.728815 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23fe7ba-eb3a-465e-b185-85c77386a538 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:42.730343 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23fe7ba-eb3a-465e-b185-85c77386a538 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:42.747553 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:42.799802 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:42.818510 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265d07a-f28d-45d4-914a-af0ea531e478 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:42.854597 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 99/192] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Aug 22 20:25:42 2022] POST /identity/v3/users => generated 297 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:25:42.855388 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fe7ba-eb3a-465e-b185-85c77386a538 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:42.855646 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fa203-4150-4b94-9960-5113fb15f316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:42.856268 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fa203-4150-4b94-9960-5113fb15f316 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:42.856769 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fa203-4150-4b94-9960-5113fb15f316 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:42.856924 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fa203-4150-4b94-9960-5113fb15f316 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:42.857707 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fa203-4150-4b94-9960-5113fb15f316 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:42.858014 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fa203-4150-4b94-9960-5113fb15f316 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:42.859466 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fa203-4150-4b94-9960-5113fb15f316 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:42.876685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 94/193] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:25:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:42.880737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fa203-4150-4b94-9960-5113fb15f316 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:42.997284 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fe7ba-eb3a-465e-b185-85c77386a538 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:43.015025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fa203-4150-4b94-9960-5113fb15f316 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:43.042766 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0413cd-6344-446c-a36b-41a853047483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:43.043383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0413cd-6344-446c-a36b-41a853047483 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:43.043663 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0413cd-6344-446c-a36b-41a853047483 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:43.043988 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0413cd-6344-446c-a36b-41a853047483 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:43.063327 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a22f65-076d-4360-8102-0281c23535cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:43.063977 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a22f65-076d-4360-8102-0281c23535cd None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:43.064256 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a22f65-076d-4360-8102-0281c23535cd None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:43.064525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a22f65-076d-4360-8102-0281c23535cd None admin] PATH_INFO: `/v3/users/fbd8426c4c9647ba87d731f863f22708` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:43.069325 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a22f65-076d-4360-8102-0281c23535cd None admin] RBAC: Authorizing `identity:get_user(user_id=fbd8426c4c9647ba87d731f863f22708)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:43.069325 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a22f65-076d-4360-8102-0281c23535cd None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:43.076679 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 95/194] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:25:42 2022] GET /identity/v3/users/fbd8426c4c9647ba87d731f863f22708 => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:43.076679 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a22f65-076d-4360-8102-0281c23535cd None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:43.096630 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:43.125349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:43.135818 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0413cd-6344-446c-a36b-41a853047483 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:43.138577 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0413cd-6344-446c-a36b-41a853047483 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:43.216428 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a22f65-076d-4360-8102-0281c23535cd None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:43.260904 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef6088-8cb2-422e-ac0a-792896a6f956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:43.261658 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef6088-8cb2-422e-ac0a-792896a6f956 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:43.261976 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef6088-8cb2-422e-ac0a-792896a6f956 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:43.262527 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef6088-8cb2-422e-ac0a-792896a6f956 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:43.268054 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 100/195] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:25:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:25:43.273609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0413cd-6344-446c-a36b-41a853047483 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:43.373311 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef6088-8cb2-422e-ac0a-792896a6f956 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:43.375126 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef6088-8cb2-422e-ac0a-792896a6f956 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:43.384366 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:43.391785 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0413cd-6344-446c-a36b-41a853047483 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:43.396835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:43.429646 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21a512-0657-41cb-8db9-fd04964df63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:43.430321 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21a512-0657-41cb-8db9-fd04964df63c None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:43.436968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21a512-0657-41cb-8db9-fd04964df63c None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:43.436968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21a512-0657-41cb-8db9-fd04964df63c None admin] PATH_INFO: `/v3/projects/d0af86473fde40a2b26933e4ecd0901a` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:43.436968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e21a512-0657-41cb-8db9-fd04964df63c None admin] RBAC: Authorizing `identity:get_project(project_id=d0af86473fde40a2b26933e4ecd0901a)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:43.436968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e21a512-0657-41cb-8db9-fd04964df63c None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:43.436968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 101/196] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:25:43 2022] GET /identity/v3/projects/d0af86473fde40a2b26933e4ecd0901a => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:25:43.436968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f709e4-93ea-46b8-9f4f-ea76b9081496 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:43.437632 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f709e4-93ea-46b8-9f4f-ea76b9081496 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:43.437632 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f709e4-93ea-46b8-9f4f-ea76b9081496 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:43.438767 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 102/197] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:43.444270 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21804fd9-a7a0-4bc7-b047-be4d6f401b79 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:43.444583 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21804fd9-a7a0-4bc7-b047-be4d6f401b79 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:43.444905 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21804fd9-a7a0-4bc7-b047-be4d6f401b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:43.466824 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-21804fd9-a7a0-4bc7-b047-be4d6f401b79 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:43.468146 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-21804fd9-a7a0-4bc7-b047-be4d6f401b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:43.506847 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 96/198] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:25:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 20:25:43.507705 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef6088-8cb2-422e-ac0a-792896a6f956 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:43.561312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 103/199] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:25:43.562449 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21804fd9-a7a0-4bc7-b047-be4d6f401b79 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:43.669129 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef6088-8cb2-422e-ac0a-792896a6f956 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:43.691905 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:43.693006 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:43.707890 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21804fd9-a7a0-4bc7-b047-be4d6f401b79 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:43.731909 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b58fa2-7a82-4201-a9b2-6fdb97426421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:43.733463 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b58fa2-7a82-4201-a9b2-6fdb97426421 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:43.733752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b58fa2-7a82-4201-a9b2-6fdb97426421 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:43.734027 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b58fa2-7a82-4201-a9b2-6fdb97426421 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:43.734776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b58fa2-7a82-4201-a9b2-6fdb97426421 None admin] RBAC: Adding query filter params (role.id=e3faa0474c054da6bb4d8910a4e40bff, scope.project.id=d0af86473fde40a2b26933e4ecd0901a, user.id=fbd8426c4c9647ba87d731f863f22708) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:43.735079 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b58fa2-7a82-4201-a9b2-6fdb97426421 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:43.736559 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b58fa2-7a82-4201-a9b2-6fdb97426421 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:43.750674 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 97/200] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:25:43 2022] GET /identity/v3/role_assignments?user.id=fbd8426c4c9647ba87d731f863f22708&scope.project.id=d0af86473fde40a2b26933e4ecd0901a&role.id=e3faa0474c054da6bb4d8910a4e40bff => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:43.763310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2092e1d-048f-4275-a06b-808854aba6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:43.763967 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2092e1d-048f-4275-a06b-808854aba6d4 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:43.764249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2092e1d-048f-4275-a06b-808854aba6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:43.764521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2092e1d-048f-4275-a06b-808854aba6d4 None admin] PATH_INFO: `/v3/projects/d0af86473fde40a2b26933e4ecd0901a` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:43.765878 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2092e1d-048f-4275-a06b-808854aba6d4 None admin] RBAC: Authorizing `identity:get_project(project_id=d0af86473fde40a2b26933e4ecd0901a)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:43.767461 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2092e1d-048f-4275-a06b-808854aba6d4 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:43.769666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 104/201] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:25:43 2022] GET /identity/v3/projects/d0af86473fde40a2b26933e4ecd0901a => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:43.778332 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b58fa2-7a82-4201-a9b2-6fdb97426421 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:43.942289 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2092e1d-048f-4275-a06b-808854aba6d4 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:43.958248 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b58fa2-7a82-4201-a9b2-6fdb97426421 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:44.027147 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ba110-e00b-4a91-b752-cd488a22b823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:44.029747 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ba110-e00b-4a91-b752-cd488a22b823 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:44.030429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ba110-e00b-4a91-b752-cd488a22b823 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:44.031898 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ba110-e00b-4a91-b752-cd488a22b823 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:44.032850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ba110-e00b-4a91-b752-cd488a22b823 None admin] RBAC: Adding query filter params (role.id=7f4b8cdb739c4f808ef31961eb11510e, scope.project.id=d0af86473fde40a2b26933e4ecd0901a, user.id=fbd8426c4c9647ba87d731f863f22708) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:44.033419 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ba110-e00b-4a91-b752-cd488a22b823 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:44.035086 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ba110-e00b-4a91-b752-cd488a22b823 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:44.041490 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 98/202] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:25:43 2022] GET /identity/v3/role_assignments?user.id=fbd8426c4c9647ba87d731f863f22708&scope.project.id=d0af86473fde40a2b26933e4ecd0901a&role.id=7f4b8cdb739c4f808ef31961eb11510e => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:44.118329 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2092e1d-048f-4275-a06b-808854aba6d4 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:44.171454 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa9705-0330-4ba6-aea7-2c865e279954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:44.172102 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa9705-0330-4ba6-aea7-2c865e279954 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:44.172384 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa9705-0330-4ba6-aea7-2c865e279954 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:44.172695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa9705-0330-4ba6-aea7-2c865e279954 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:44.183891 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa9705-0330-4ba6-aea7-2c865e279954 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:25:44.189087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-c8aa9705-0330-4ba6-aea7-2c865e279954 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:25:44.189087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:25:44.189087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:25:44.189087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:25:44.189087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:25:44.189087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:25:44.189087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:25:44.189087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:25:44.189087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:25:44.189087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:25:44.189087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:25:44.189087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:25:44.189087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:25:44.189087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:25:44.189087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:25:44.189087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:25:44.189911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:25:44.189911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:25:44.189911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:25:44.189911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:25:44.189911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:25:44.189911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:25:44.189911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:25:44.189911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:25:44.189911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:25:44.189911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:25:44.189911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:25:44.189911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:25:44.189911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:25:44.189911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:25:44.189911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:25:44.189911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:25:44.190899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:25:44.190899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:25:44.190899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:25:44.190899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:25:44.190899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:25:44.190899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:25:44.190899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:25:44.190899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:25:44.190899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:25:44.190899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:25:44.190899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:25:44.190899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:25:44.190899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 105/203] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:25:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:25:44.202121 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ba110-e00b-4a91-b752-cd488a22b823 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:44.287012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:44.351687 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ba110-e00b-4a91-b752-cd488a22b823 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:44.395763 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d8e6c-7107-460b-8e8c-a5f3f32123cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:44.396381 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d8e6c-7107-460b-8e8c-a5f3f32123cf None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:44.396682 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d8e6c-7107-460b-8e8c-a5f3f32123cf None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:44.396962 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d8e6c-7107-460b-8e8c-a5f3f32123cf None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:44.397696 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d8e6c-7107-460b-8e8c-a5f3f32123cf None admin] RBAC: Adding query filter params (name=reader) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:44.398000 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d8e6c-7107-460b-8e8c-a5f3f32123cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:44.399706 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d8e6c-7107-460b-8e8c-a5f3f32123cf None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:44.412685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 99/204] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 22 20:25:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:44.418365 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa9705-0330-4ba6-aea7-2c865e279954 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:44.442023 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:44.543360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa9705-0330-4ba6-aea7-2c865e279954 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:44.595239 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d604c-9518-43c7-819d-217db244fc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:44.595877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d604c-9518-43c7-819d-217db244fc1d None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:44.596155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d604c-9518-43c7-819d-217db244fc1d None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:44.596428 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d604c-9518-43c7-819d-217db244fc1d None admin] PATH_INFO: `/v3/users/41d69b9a30df40f8ad2c9b4ef7d636a4` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:44.597647 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d604c-9518-43c7-819d-217db244fc1d None admin] RBAC: Authorizing `identity:get_user(user_id=41d69b9a30df40f8ad2c9b4ef7d636a4)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:44.599104 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d604c-9518-43c7-819d-217db244fc1d None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:44.600901 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 106/205] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:25:44 2022] GET /identity/v3/users/41d69b9a30df40f8ad2c9b4ef7d636a4 => generated 289 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:44.606501 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d8e6c-7107-460b-8e8c-a5f3f32123cf None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:44.756846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d8e6c-7107-460b-8e8c-a5f3f32123cf None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:44.761764 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:44.829393 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25161829-b45e-41d2-b5f0-bf9761e0321d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:44.830021 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25161829-b45e-41d2-b5f0-bf9761e0321d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:44.830309 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25161829-b45e-41d2-b5f0-bf9761e0321d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:44.830584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25161829-b45e-41d2-b5f0-bf9761e0321d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:44.960872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25161829-b45e-41d2-b5f0-bf9761e0321d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:44.962644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25161829-b45e-41d2-b5f0-bf9761e0321d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:45.097682 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 100/206] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:25:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:25:45.103907 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d604c-9518-43c7-819d-217db244fc1d None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:45.216240 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:45.228978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d604c-9518-43c7-819d-217db244fc1d None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:45.264056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bab6f-a371-445b-86b3-4d70fdfe2559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:45.264722 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bab6f-a371-445b-86b3-4d70fdfe2559 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:45.265425 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bab6f-a371-445b-86b3-4d70fdfe2559 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:45.265706 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bab6f-a371-445b-86b3-4d70fdfe2559 None admin] PATH_INFO: `/v3/projects/3883b1b257924533a84cbc24a92ea6e1` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:45.266932 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1bab6f-a371-445b-86b3-4d70fdfe2559 None admin] RBAC: Authorizing `identity:get_project(project_id=3883b1b257924533a84cbc24a92ea6e1)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:45.269204 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1bab6f-a371-445b-86b3-4d70fdfe2559 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:45.271061 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 107/207] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:25:45 2022] GET /identity/v3/projects/3883b1b257924533a84cbc24a92ea6e1 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:45.277519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25161829-b45e-41d2-b5f0-bf9761e0321d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:45.280906 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:45.404730 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25161829-b45e-41d2-b5f0-bf9761e0321d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:45.458406 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb901cd3-b2d9-467c-8bdc-d3efe2e948de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:45.459016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb901cd3-b2d9-467c-8bdc-d3efe2e948de None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:45.459298 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb901cd3-b2d9-467c-8bdc-d3efe2e948de None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:45.459574 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb901cd3-b2d9-467c-8bdc-d3efe2e948de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:45.460305 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb901cd3-b2d9-467c-8bdc-d3efe2e948de None admin] RBAC: Adding query filter params (role.id=c1ddd6c095d041d4a18c8cf126582891, scope.project.id=3883b1b257924533a84cbc24a92ea6e1, user.id=41d69b9a30df40f8ad2c9b4ef7d636a4) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:45.460628 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb901cd3-b2d9-467c-8bdc-d3efe2e948de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:45.462155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb901cd3-b2d9-467c-8bdc-d3efe2e948de None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:45.473117 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 101/208] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:25:45 2022] GET /identity/v3/role_assignments?user.id=41d69b9a30df40f8ad2c9b4ef7d636a4&scope.project.id=3883b1b257924533a84cbc24a92ea6e1&role.id=c1ddd6c095d041d4a18c8cf126582891 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:45.606672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78aa1b-48c3-4b18-824a-035fe9ba1aab None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:45.607018 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78aa1b-48c3-4b18-824a-035fe9ba1aab None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:45.607232 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78aa1b-48c3-4b18-824a-035fe9ba1aab None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:45.608584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 108/209] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:45.615441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d64c3a-6357-4c7a-af20-1641a18a631c None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:45.615724 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d64c3a-6357-4c7a-af20-1641a18a631c None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:45.616017 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d64c3a-6357-4c7a-af20-1641a18a631c None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:45.617446 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 109/210] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:25:45.618306 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cc419-47e6-4ac8-af1f-bc26df4b6916 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:45.618619 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cc419-47e6-4ac8-af1f-bc26df4b6916 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:45.619084 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cc419-47e6-4ac8-af1f-bc26df4b6916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:45.623433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca210b9-9df1-4c57-a90e-e8fbfd119cee None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:45.623721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca210b9-9df1-4c57-a90e-e8fbfd119cee None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:45.623996 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca210b9-9df1-4c57-a90e-e8fbfd119cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:45.646171 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-b39cc419-47e6-4ac8-af1f-bc26df4b6916 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:45.647697 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b39cc419-47e6-4ac8-af1f-bc26df4b6916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:45.649451 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-9ca210b9-9df1-4c57-a90e-e8fbfd119cee None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:45.650661 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-9ca210b9-9df1-4c57-a90e-e8fbfd119cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:45.724437 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:45.731512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 102/211] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:25:45.762122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 110/212] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:25:45.929462 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad21f7b-35e4-436f-8d2b-fe05b1aacdf0 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:45.930951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad21f7b-35e4-436f-8d2b-fe05b1aacdf0 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:45.931485 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad21f7b-35e4-436f-8d2b-fe05b1aacdf0 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:45.933080 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 103/213] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:45.940015 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d0db9-620c-475c-9e1d-90977f616874 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:45.940583 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d0db9-620c-475c-9e1d-90977f616874 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:45.941105 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d0db9-620c-475c-9e1d-90977f616874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:45.960857 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-7f9d0db9-620c-475c-9e1d-90977f616874 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:45.962456 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-7f9d0db9-620c-475c-9e1d-90977f616874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:46.036682 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 111/214] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:25:46.052373 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad21f7b-35e4-436f-8d2b-fe05b1aacdf0 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:46.054647 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d0db9-620c-475c-9e1d-90977f616874 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:46.073277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:46.165889 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad21f7b-35e4-436f-8d2b-fe05b1aacdf0 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:46.179592 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d0db9-620c-475c-9e1d-90977f616874 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:46.215021 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ced32d-e9e9-46ae-91db-e6f1402d23e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:46.216236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ced32d-e9e9-46ae-91db-e6f1402d23e1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:46.216684 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ced32d-e9e9-46ae-91db-e6f1402d23e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:46.217101 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ced32d-e9e9-46ae-91db-e6f1402d23e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:46.219591 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217fdbb-6159-4934-9d4b-50911c715b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:46.220415 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217fdbb-6159-4934-9d4b-50911c715b47 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:46.220828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217fdbb-6159-4934-9d4b-50911c715b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:46.221215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217fdbb-6159-4934-9d4b-50911c715b47 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:46.222457 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3217fdbb-6159-4934-9d4b-50911c715b47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:46.224077 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3217fdbb-6159-4934-9d4b-50911c715b47 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:46.229971 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ced32d-e9e9-46ae-91db-e6f1402d23e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:25:46.231166 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 112/215] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:25:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:25:46.232423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217fdbb-6159-4934-9d4b-50911c715b47 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:46.235935 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-44ced32d-e9e9-46ae-91db-e6f1402d23e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:25:46.235935 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:25:46.235935 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:25:46.235935 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:25:46.235935 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:25:46.235935 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:25:46.235935 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:25:46.235935 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:25:46.235935 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:25:46.235935 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:25:46.235935 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:25:46.235935 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:25:46.235935 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:25:46.235935 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:25:46.235935 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:25:46.235935 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:25:46.236969 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:25:46.236969 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:25:46.236969 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:25:46.236969 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:25:46.236969 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:25:46.236969 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:25:46.236969 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:25:46.236969 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:25:46.236969 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:25:46.236969 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:25:46.236969 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:25:46.236969 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:25:46.236969 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:25:46.236969 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:25:46.236969 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:25:46.236969 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:25:46.237787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:25:46.237787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:25:46.237787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:25:46.237787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:25:46.237787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:25:46.237787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:25:46.237787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:25:46.237787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:25:46.237787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:25:46.237787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:25:46.237787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:25:46.237787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:25:46.240787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 104/216] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:25:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:25:46.247661 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ced32d-e9e9-46ae-91db-e6f1402d23e1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:46.329870 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:46.334206 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:46.350325 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217fdbb-6159-4934-9d4b-50911c715b47 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:46.380037 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ced32d-e9e9-46ae-91db-e6f1402d23e1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:46.388283 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4adc27e-9ddc-4cc7-8aa5-1f3472c71789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:46.389130 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adc27e-9ddc-4cc7-8aa5-1f3472c71789 None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:46.390171 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adc27e-9ddc-4cc7-8aa5-1f3472c71789 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:46.390463 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adc27e-9ddc-4cc7-8aa5-1f3472c71789 None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:46.391623 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4adc27e-9ddc-4cc7-8aa5-1f3472c71789 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:46.393417 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4adc27e-9ddc-4cc7-8aa5-1f3472c71789 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:46.414059 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0dc42-c629-4dc4-b953-2caee2d75b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:46.415342 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0dc42-c629-4dc4-b953-2caee2d75b3d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:46.415798 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0dc42-c629-4dc4-b953-2caee2d75b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:46.422051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0dc42-c629-4dc4-b953-2caee2d75b3d None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:46.422051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0dc42-c629-4dc4-b953-2caee2d75b3d None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:46.422051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0dc42-c629-4dc4-b953-2caee2d75b3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:46.422051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0dc42-c629-4dc4-b953-2caee2d75b3d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:46.427200 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 105/217] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 22 20:25:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:46.428856 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0dc42-c629-4dc4-b953-2caee2d75b3d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:46.512687 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 113/218] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Aug 22 20:25:46 2022] POST /identity/v3/users => generated 297 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:25:46.512687 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4adc27e-9ddc-4cc7-8aa5-1f3472c71789 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:46.556477 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0dc42-c629-4dc4-b953-2caee2d75b3d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:46.578248 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:46.599929 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023862cc-25b6-4dad-bfda-ffa6b3f7c7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:46.599929 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023862cc-25b6-4dad-bfda-ffa6b3f7c7d9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:46.599929 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023862cc-25b6-4dad-bfda-ffa6b3f7c7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:46.599929 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023862cc-25b6-4dad-bfda-ffa6b3f7c7d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:46.609511 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023862cc-25b6-4dad-bfda-ffa6b3f7c7d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:25:46.614277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-023862cc-25b6-4dad-bfda-ffa6b3f7c7d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:25:46.614277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:25:46.614277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:25:46.614277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:25:46.614277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:25:46.614277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:25:46.614277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:25:46.614277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:25:46.614277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:25:46.614277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:25:46.614277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:25:46.614277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:25:46.614277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:25:46.614277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:25:46.614277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:25:46.614277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:25:46.615396 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:25:46.615396 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:25:46.615396 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:25:46.615396 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:25:46.615396 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:25:46.615396 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:25:46.615396 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:25:46.615396 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:25:46.615396 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:25:46.615396 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:25:46.615396 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:25:46.615396 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:25:46.615396 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:25:46.615396 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:25:46.615396 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:25:46.615396 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:25:46.616178 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:25:46.616178 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:25:46.616178 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:25:46.616178 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:25:46.616178 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:25:46.616178 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:25:46.616178 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:25:46.616178 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:25:46.616178 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:25:46.616178 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:25:46.616178 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:25:46.616178 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:25:46.616178 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 106/219] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 22 20:25:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:25:46.617912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b67a0-d684-48f4-ad7b-1f677ef5e523 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:46.617912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b67a0-d684-48f4-ad7b-1f677ef5e523 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:46.617912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b67a0-d684-48f4-ad7b-1f677ef5e523 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:46.619428 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 107/220] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:46.621855 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b67a0-d684-48f4-ad7b-1f677ef5e523 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:46.633435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4adc27e-9ddc-4cc7-8aa5-1f3472c71789 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:46.680497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a60ae-75d3-48be-81c9-6832fffe2cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:46.681227 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a60ae-75d3-48be-81c9-6832fffe2cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:46.682004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a60ae-75d3-48be-81c9-6832fffe2cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:46.682279 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a60ae-75d3-48be-81c9-6832fffe2cf5 None admin] PATH_INFO: `/v3/users/e7e85dbb3ff0449aa9335f9ecea3491c` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:46.694394 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:46.697581 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a60ae-75d3-48be-81c9-6832fffe2cf5 None admin] RBAC: Authorizing `identity:get_user(user_id=e7e85dbb3ff0449aa9335f9ecea3491c)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:46.699057 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a60ae-75d3-48be-81c9-6832fffe2cf5 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:46.700858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 114/221] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:25:46 2022] GET /identity/v3/users/e7e85dbb3ff0449aa9335f9ecea3491c => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:46.701994 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738f99a-9635-4f3f-a98e-2dc81f718a35 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:46.702278 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738f99a-9635-4f3f-a98e-2dc81f718a35 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:46.702551 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738f99a-9635-4f3f-a98e-2dc81f718a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:46.725144 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-c738f99a-9635-4f3f-a98e-2dc81f718a35 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:46.726349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-c738f99a-9635-4f3f-a98e-2dc81f718a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:46.745252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b67a0-d684-48f4-ad7b-1f677ef5e523 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:46.791017 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf188161-ee03-4257-a87b-042d7ae1dc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:46.791638 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf188161-ee03-4257-a87b-042d7ae1dc4b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:46.791911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf188161-ee03-4257-a87b-042d7ae1dc4b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:46.793013 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf188161-ee03-4257-a87b-042d7ae1dc4b None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:46.793013 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf188161-ee03-4257-a87b-042d7ae1dc4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:46.793197 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf188161-ee03-4257-a87b-042d7ae1dc4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:46.794552 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf188161-ee03-4257-a87b-042d7ae1dc4b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:46.808966 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 108/222] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:25:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:25:46.810713 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf188161-ee03-4257-a87b-042d7ae1dc4b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:46.815490 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 115/223] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:25:46.821753 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738f99a-9635-4f3f-a98e-2dc81f718a35 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:46.864075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:46.942630 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf188161-ee03-4257-a87b-042d7ae1dc4b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:46.943523 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738f99a-9635-4f3f-a98e-2dc81f718a35 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:46.986948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:46.998280 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d05c99-afa1-416c-bf6d-776ee5f1970a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:47.004100 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d05c99-afa1-416c-bf6d-776ee5f1970a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:47.004100 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d05c99-afa1-416c-bf6d-776ee5f1970a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:47.004100 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d05c99-afa1-416c-bf6d-776ee5f1970a None admin] PATH_INFO: `/v3/users/fbd8426c4c9647ba87d731f863f22708` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:47.004525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816aed32-40dd-4ade-b73f-f13a6217a8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:47.004525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816aed32-40dd-4ade-b73f-f13a6217a8b2 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:47.004525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816aed32-40dd-4ade-b73f-f13a6217a8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:47.004525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816aed32-40dd-4ade-b73f-f13a6217a8b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:47.004829 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d05c99-afa1-416c-bf6d-776ee5f1970a None admin] RBAC: Authorizing `identity:get_user(user_id=fbd8426c4c9647ba87d731f863f22708)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:47.009809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d05c99-afa1-416c-bf6d-776ee5f1970a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:47.011716 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 116/224] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:25:46 2022] GET /identity/v3/users/fbd8426c4c9647ba87d731f863f22708 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:47.018036 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d05c99-afa1-416c-bf6d-776ee5f1970a None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:47.108637 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816aed32-40dd-4ade-b73f-f13a6217a8b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:47.110523 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816aed32-40dd-4ade-b73f-f13a6217a8b2 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:47.167482 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:47.186431 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d05c99-afa1-416c-bf6d-776ee5f1970a None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:47.224185 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce119f-fa24-478d-b83e-c99711445f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:47.224846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce119f-fa24-478d-b83e-c99711445f95 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:47.225124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce119f-fa24-478d-b83e-c99711445f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:47.225396 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce119f-fa24-478d-b83e-c99711445f95 None admin] PATH_INFO: `/v3/projects/d0af86473fde40a2b26933e4ecd0901a` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:47.226512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce119f-fa24-478d-b83e-c99711445f95 None admin] RBAC: Authorizing `identity:get_project(project_id=d0af86473fde40a2b26933e4ecd0901a)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:47.228345 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce119f-fa24-478d-b83e-c99711445f95 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:47.234265 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 117/225] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:25:47 2022] GET /identity/v3/projects/d0af86473fde40a2b26933e4ecd0901a => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:47.234265 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce119f-fa24-478d-b83e-c99711445f95 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:47.246087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 109/226] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:25:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:25:47.247295 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816aed32-40dd-4ade-b73f-f13a6217a8b2 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:47.296829 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:47.337921 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce119f-fa24-478d-b83e-c99711445f95 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:47.354024 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816aed32-40dd-4ade-b73f-f13a6217a8b2 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:47.374312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1630c-e599-4e17-a7b9-00c02875c9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:47.374944 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1630c-e599-4e17-a7b9-00c02875c9bc None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:47.375220 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1630c-e599-4e17-a7b9-00c02875c9bc None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:47.375490 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1630c-e599-4e17-a7b9-00c02875c9bc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:47.386992 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e1630c-e599-4e17-a7b9-00c02875c9bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:25:47.391842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-45e1630c-e599-4e17-a7b9-00c02875c9bc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:25:47.391842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:25:47.391842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:25:47.391842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:25:47.391842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:25:47.391842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:25:47.391842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:25:47.391842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:25:47.391842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:25:47.391842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:25:47.391842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:25:47.391842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:25:47.391842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:25:47.391842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:25:47.391842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:25:47.391842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:25:47.392758 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:25:47.392758 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:25:47.392758 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:25:47.392758 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:25:47.392758 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:25:47.392758 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:25:47.392758 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:25:47.392758 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:25:47.392758 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:25:47.392758 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:25:47.392758 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:25:47.392758 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:25:47.392758 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:25:47.392758 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:25:47.392758 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:25:47.392758 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:25:47.393531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:25:47.393531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:25:47.393531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:25:47.393531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:25:47.393531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:25:47.393531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:25:47.393531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:25:47.393531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:25:47.393531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:25:47.393531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:25:47.393531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:25:47.393531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:25:47.393531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 118/227] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 22 20:25:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:25:47.394179 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1630c-e599-4e17-a7b9-00c02875c9bc None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:47.400198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0362a-e839-4d65-bc1a-917383bb1bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:47.401198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0362a-e839-4d65-bc1a-917383bb1bb2 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:47.401797 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0362a-e839-4d65-bc1a-917383bb1bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:47.402270 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0362a-e839-4d65-bc1a-917383bb1bb2 None admin] PATH_INFO: `/v3/projects/d0af86473fde40a2b26933e4ecd0901a/users/fbd8426c4c9647ba87d731f863f22708/roles/e3faa0474c054da6bb4d8910a4e40bff` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:47.405063 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd0362a-e839-4d65-bc1a-917383bb1bb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0af86473fde40a2b26933e4ecd0901a, user_id=fbd8426c4c9647ba87d731f863f22708, role_id=e3faa0474c054da6bb4d8910a4e40bff)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:47.407197 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd0362a-e839-4d65-bc1a-917383bb1bb2 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:47.485954 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 110/228] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 22 20:25:47 2022] PUT /identity/v3/projects/d0af86473fde40a2b26933e4ecd0901a/users/fbd8426c4c9647ba87d731f863f22708/roles/e3faa0474c054da6bb4d8910a4e40bff => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:25:47.490893 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0362a-e839-4d65-bc1a-917383bb1bb2 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:47.517061 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:47.522551 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1630c-e599-4e17-a7b9-00c02875c9bc None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:47.552128 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:47.564980 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4b40a-41cc-4db6-bb53-2ac32dc50027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:47.565628 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4b40a-41cc-4db6-bb53-2ac32dc50027 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:47.565904 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4b40a-41cc-4db6-bb53-2ac32dc50027 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:47.566349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf4b40a-41cc-4db6-bb53-2ac32dc50027 None admin] PATH_INFO: `/v3/projects/d0af86473fde40a2b26933e4ecd0901a` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:47.567667 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4b40a-41cc-4db6-bb53-2ac32dc50027 None admin] RBAC: Authorizing `identity:get_project(project_id=d0af86473fde40a2b26933e4ecd0901a)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:47.569313 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf4b40a-41cc-4db6-bb53-2ac32dc50027 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:47.571924 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 119/229] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:25:47 2022] GET /identity/v3/projects/d0af86473fde40a2b26933e4ecd0901a => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:47.577988 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4b40a-41cc-4db6-bb53-2ac32dc50027 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:47.709709 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0362a-e839-4d65-bc1a-917383bb1bb2 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:47.733727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf4b40a-41cc-4db6-bb53-2ac32dc50027 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:47.748470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8481506-cea7-4c1c-beba-0f35916a3579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:47.749090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8481506-cea7-4c1c-beba-0f35916a3579 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:47.749364 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8481506-cea7-4c1c-beba-0f35916a3579 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:47.749675 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8481506-cea7-4c1c-beba-0f35916a3579 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:47.750344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8481506-cea7-4c1c-beba-0f35916a3579 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:47.750643 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8481506-cea7-4c1c-beba-0f35916a3579 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:47.752025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8481506-cea7-4c1c-beba-0f35916a3579 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:47.762592 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 111/230] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:25:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:47.772195 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8481506-cea7-4c1c-beba-0f35916a3579 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:47.780112 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961db66-2506-49cc-b8c6-09de10335d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:47.781080 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961db66-2506-49cc-b8c6-09de10335d81 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:47.781565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961db66-2506-49cc-b8c6-09de10335d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:47.782062 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961db66-2506-49cc-b8c6-09de10335d81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:47.783112 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961db66-2506-49cc-b8c6-09de10335d81 None admin] RBAC: Adding query filter params (role.id=028945f544094c26933c8ef60a480e9a, scope.project.id=d0af86473fde40a2b26933e4ecd0901a, user.id=e7e85dbb3ff0449aa9335f9ecea3491c) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:47.783629 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961db66-2506-49cc-b8c6-09de10335d81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:47.785444 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961db66-2506-49cc-b8c6-09de10335d81 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:47.792858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 120/231] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:25:47 2022] GET /identity/v3/role_assignments?user.id=e7e85dbb3ff0449aa9335f9ecea3491c&scope.project.id=d0af86473fde40a2b26933e4ecd0901a&role.id=028945f544094c26933c8ef60a480e9a => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:47.857034 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:47.898300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8481506-cea7-4c1c-beba-0f35916a3579 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:47.946907 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a08c7b-de9c-49bf-b0cd-b555f42652ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:47.947569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a08c7b-de9c-49bf-b0cd-b555f42652ef None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:47.947864 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a08c7b-de9c-49bf-b0cd-b555f42652ef None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:47.948091 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a08c7b-de9c-49bf-b0cd-b555f42652ef None admin] PATH_INFO: `/v3/users/fbd8426c4c9647ba87d731f863f22708` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:47.951520 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a08c7b-de9c-49bf-b0cd-b555f42652ef None admin] RBAC: Authorizing `identity:get_user(user_id=fbd8426c4c9647ba87d731f863f22708)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:47.952892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a08c7b-de9c-49bf-b0cd-b555f42652ef None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:47.954575 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 112/232] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:25:47 2022] GET /identity/v3/users/fbd8426c4c9647ba87d731f863f22708 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:47.960446 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961db66-2506-49cc-b8c6-09de10335d81 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:48.058301 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:48.106454 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961db66-2506-49cc-b8c6-09de10335d81 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:48.153945 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09710a-149f-41c4-877f-615539164b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:48.154580 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09710a-149f-41c4-877f-615539164b4c None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:48.154858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09710a-149f-41c4-877f-615539164b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:48.155128 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09710a-149f-41c4-877f-615539164b4c None admin] PATH_INFO: `/v3/projects/d0af86473fde40a2b26933e4ecd0901a` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:48.156255 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad09710a-149f-41c4-877f-615539164b4c None admin] RBAC: Authorizing `identity:get_project(project_id=d0af86473fde40a2b26933e4ecd0901a)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:48.157744 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad09710a-149f-41c4-877f-615539164b4c None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:48.159357 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 121/233] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:25:47 2022] GET /identity/v3/projects/d0af86473fde40a2b26933e4ecd0901a => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:48.165695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a08c7b-de9c-49bf-b0cd-b555f42652ef None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:48.324360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a08c7b-de9c-49bf-b0cd-b555f42652ef None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:48.357039 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:48.362624 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd522a-1c96-4bf8-9cf1-51ada1368b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:48.363342 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd522a-1c96-4bf8-9cf1-51ada1368b13 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:48.363622 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd522a-1c96-4bf8-9cf1-51ada1368b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:48.363895 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd522a-1c96-4bf8-9cf1-51ada1368b13 None admin] PATH_INFO: `/v3/projects/d0af86473fde40a2b26933e4ecd0901a/users/fbd8426c4c9647ba87d731f863f22708/roles/7f4b8cdb739c4f808ef31961eb11510e` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:48.366272 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd522a-1c96-4bf8-9cf1-51ada1368b13 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0af86473fde40a2b26933e4ecd0901a, user_id=fbd8426c4c9647ba87d731f863f22708, role_id=7f4b8cdb739c4f808ef31961eb11510e)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:48.368144 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd522a-1c96-4bf8-9cf1-51ada1368b13 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:48.476392 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 113/234] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 22 20:25:48 2022] PUT /identity/v3/projects/d0af86473fde40a2b26933e4ecd0901a/users/fbd8426c4c9647ba87d731f863f22708/roles/7f4b8cdb739c4f808ef31961eb11510e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:25:48.815593 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d1e1b-dc91-430b-a4ff-9548b823df95 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:48.815593 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d1e1b-dc91-430b-a4ff-9548b823df95 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:48.815593 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71d1e1b-dc91-430b-a4ff-9548b823df95 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:48.816751 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 122/235] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:48.822346 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d9f23-6c95-43a8-b1f9-bbfbeaf22787 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:48.822898 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d9f23-6c95-43a8-b1f9-bbfbeaf22787 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:48.823383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d9f23-6c95-43a8-b1f9-bbfbeaf22787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:48.842638 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-6b0d9f23-6c95-43a8-b1f9-bbfbeaf22787 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:48.844157 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6b0d9f23-6c95-43a8-b1f9-bbfbeaf22787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:48.934928 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 114/236] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:25:49.089960 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c05b60-18c4-4111-80c1-604a6dad4b01 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:49.090253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c05b60-18c4-4111-80c1-604a6dad4b01 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:49.090492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c05b60-18c4-4111-80c1-604a6dad4b01 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:49.092065 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 123/237] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:49.097410 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826391f-4cb9-4722-bf3f-51c253dab0ff None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:49.097843 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826391f-4cb9-4722-bf3f-51c253dab0ff None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:49.097958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826391f-4cb9-4722-bf3f-51c253dab0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:49.121588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-1826391f-4cb9-4722-bf3f-51c253dab0ff None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:49.122777 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1826391f-4cb9-4722-bf3f-51c253dab0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:49.194540 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 115/238] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:25:49.251086 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c05b60-18c4-4111-80c1-604a6dad4b01 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:49.363423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c05b60-18c4-4111-80c1-604a6dad4b01 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:49.389046 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:49.400081 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8385d-baf1-45c9-b9a2-105ad0b396ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:49.400740 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8385d-baf1-45c9-b9a2-105ad0b396ac None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:49.405678 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8385d-baf1-45c9-b9a2-105ad0b396ac None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:49.405678 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8385d-baf1-45c9-b9a2-105ad0b396ac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:49.412081 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8385d-baf1-45c9-b9a2-105ad0b396ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:25:49.417688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-2da8385d-baf1-45c9-b9a2-105ad0b396ac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:25:49.417688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:25:49.417688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:25:49.417688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:25:49.417688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:25:49.417688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:25:49.417688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:25:49.417688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:25:49.417688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:25:49.417688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:25:49.417688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:25:49.417688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:25:49.417688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:25:49.417688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:25:49.417688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:25:49.417688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:25:49.418737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:25:49.418737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:25:49.418737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:25:49.418737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:25:49.418737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:25:49.418737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:25:49.418737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:25:49.418737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:25:49.418737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:25:49.418737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:25:49.418737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:25:49.418737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:25:49.418737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:25:49.418737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:25:49.418737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:25:49.418737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:25:49.419877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:25:49.419877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:25:49.419877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:25:49.419877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:25:49.419877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:25:49.419877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:25:49.419877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:25:49.419877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:25:49.419877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:25:49.419877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:25:49.419877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:25:49.419877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:25:49.419877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 124/239] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:25:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:25:49.424927 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826391f-4cb9-4722-bf3f-51c253dab0ff None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:49.490194 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:49.500224 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8385d-baf1-45c9-b9a2-105ad0b396ac None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:49.578324 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826391f-4cb9-4722-bf3f-51c253dab0ff None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:49.657366 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628a217-ca66-45a1-8db6-77d6650808b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:49.658003 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628a217-ca66-45a1-8db6-77d6650808b6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:49.658277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628a217-ca66-45a1-8db6-77d6650808b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:49.658545 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628a217-ca66-45a1-8db6-77d6650808b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:49.659221 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628a217-ca66-45a1-8db6-77d6650808b6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:49.659522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628a217-ca66-45a1-8db6-77d6650808b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:49.660939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628a217-ca66-45a1-8db6-77d6650808b6 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:49.661389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8385d-baf1-45c9-b9a2-105ad0b396ac None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:49.680517 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 116/240] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 22 20:25:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:49.685801 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628a217-ca66-45a1-8db6-77d6650808b6 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:49.700901 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b54c26-1fee-4baa-bcae-0e3918c1768c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:49.701881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b54c26-1fee-4baa-bcae-0e3918c1768c None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:49.702358 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b54c26-1fee-4baa-bcae-0e3918c1768c None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:49.702826 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b54c26-1fee-4baa-bcae-0e3918c1768c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:49.704230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b54c26-1fee-4baa-bcae-0e3918c1768c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:49.706176 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b54c26-1fee-4baa-bcae-0e3918c1768c None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:49.708044 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 125/241] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:25:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:25:49.717698 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b54c26-1fee-4baa-bcae-0e3918c1768c None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:49.817015 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:49.835019 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628a217-ca66-45a1-8db6-77d6650808b6 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:49.849472 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:49.871504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9ccd5-5197-4d1f-b5d9-6cd9510d9ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:49.872139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9ccd5-5197-4d1f-b5d9-6cd9510d9ded None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:49.872417 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9ccd5-5197-4d1f-b5d9-6cd9510d9ded None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:49.872731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9ccd5-5197-4d1f-b5d9-6cd9510d9ded None admin] PATH_INFO: `/v3/users/f43b9bfda4084fe39670022a6945abff` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:49.897680 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9ccd5-5197-4d1f-b5d9-6cd9510d9ded None admin] RBAC: Authorizing `identity:get_user(user_id=f43b9bfda4084fe39670022a6945abff)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:49.899691 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9ccd5-5197-4d1f-b5d9-6cd9510d9ded None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:49.902479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 117/242] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:25:49 2022] GET /identity/v3/users/f43b9bfda4084fe39670022a6945abff => generated 297 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:25:49.910806 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b54c26-1fee-4baa-bcae-0e3918c1768c None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:49.911698 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9ccd5-5197-4d1f-b5d9-6cd9510d9ded None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:49.989389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d58c3-a903-4416-bce2-869a04bd91f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:49.990018 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d58c3-a903-4416-bce2-869a04bd91f7 None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:49.990305 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d58c3-a903-4416-bce2-869a04bd91f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:49.990584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d58c3-a903-4416-bce2-869a04bd91f7 None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:49.991244 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d58c3-a903-4416-bce2-869a04bd91f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:49.992778 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d58c3-a903-4416-bce2-869a04bd91f7 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:50.045738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9ccd5-5197-4d1f-b5d9-6cd9510d9ded None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:50.081912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb4e9a-072a-4284-be31-7788eb1dd6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:50.082566 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb4e9a-072a-4284-be31-7788eb1dd6de None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:50.082828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb4e9a-072a-4284-be31-7788eb1dd6de None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:50.083094 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb4e9a-072a-4284-be31-7788eb1dd6de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:50.124306 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 126/243] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Aug 22 20:25:49 2022] POST /identity/v3/users => generated 293 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:25:50.124306 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b85355-605f-45d4-92aa-15cb2c1450ef None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:50.124306 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b85355-605f-45d4-92aa-15cb2c1450ef None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:50.124306 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b85355-605f-45d4-92aa-15cb2c1450ef None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:50.124306 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 127/244] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:50.132127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:50.141698 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b80060-2f28-4340-95fb-c34ddd691336 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:50.141979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b80060-2f28-4340-95fb-c34ddd691336 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:50.142238 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b80060-2f28-4340-95fb-c34ddd691336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:50.169048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-41b80060-2f28-4340-95fb-c34ddd691336 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:50.170197 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-41b80060-2f28-4340-95fb-c34ddd691336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:50.193257 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb4e9a-072a-4284-be31-7788eb1dd6de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:50.194769 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb4e9a-072a-4284-be31-7788eb1dd6de None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:50.307153 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 128/245] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:25:50.365143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29645858-ee79-4edf-8a7c-d481134fea34 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:50.365453 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29645858-ee79-4edf-8a7c-d481134fea34 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:50.365686 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29645858-ee79-4edf-8a7c-d481134fea34 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:50.367617 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 118/246] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:25:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:25:50.371506 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 129/247] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:50.373128 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc836a-86a6-4f3d-b304-6d3a298c37d9 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:50.373555 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc836a-86a6-4f3d-b304-6d3a298c37d9 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:50.373973 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc836a-86a6-4f3d-b304-6d3a298c37d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:50.374689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29645858-ee79-4edf-8a7c-d481134fea34 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:50.396135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-98cc836a-86a6-4f3d-b304-6d3a298c37d9 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:50.398789 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-98cc836a-86a6-4f3d-b304-6d3a298c37d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:50.431617 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:50.497665 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29645858-ee79-4edf-8a7c-d481134fea34 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:50.510665 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 119/248] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:25:50.545903 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8f4ff-87ca-4a44-833a-0617603a63fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:50.546632 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8f4ff-87ca-4a44-833a-0617603a63fe None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:50.546906 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8f4ff-87ca-4a44-833a-0617603a63fe None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:50.547173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8f4ff-87ca-4a44-833a-0617603a63fe None admin] PATH_INFO: `/v3/projects/d0af86473fde40a2b26933e4ecd0901a` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:50.549184 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8f4ff-87ca-4a44-833a-0617603a63fe None admin] RBAC: Authorizing `identity:get_project(project_id=d0af86473fde40a2b26933e4ecd0901a)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:50.550732 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8f4ff-87ca-4a44-833a-0617603a63fe None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:50.552760 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 130/249] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:25:50 2022] GET /identity/v3/projects/d0af86473fde40a2b26933e4ecd0901a => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:50.558939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc836a-86a6-4f3d-b304-6d3a298c37d9 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:50.561544 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:50.628507 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8f4ff-87ca-4a44-833a-0617603a63fe None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:50.699260 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc836a-86a6-4f3d-b304-6d3a298c37d9 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:50.749097 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee329b5-a033-4748-bbf3-f863d3b34267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:50.749703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee329b5-a033-4748-bbf3-f863d3b34267 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:50.749979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee329b5-a033-4748-bbf3-f863d3b34267 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:50.750248 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee329b5-a033-4748-bbf3-f863d3b34267 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:50.751149 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee329b5-a033-4748-bbf3-f863d3b34267 None admin] RBAC: Adding query filter params (role.id=c1ddd6c095d041d4a18c8cf126582891, scope.project.id=d0af86473fde40a2b26933e4ecd0901a, user.id=f43b9bfda4084fe39670022a6945abff) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:50.751453 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee329b5-a033-4748-bbf3-f863d3b34267 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:50.752927 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee329b5-a033-4748-bbf3-f863d3b34267 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:50.759380 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 120/250] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:25:50 2022] GET /identity/v3/role_assignments?user.id=f43b9bfda4084fe39670022a6945abff&scope.project.id=d0af86473fde40a2b26933e4ecd0901a&role.id=c1ddd6c095d041d4a18c8cf126582891 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:50.775181 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8f4ff-87ca-4a44-833a-0617603a63fe None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:50.784090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:50.826713 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee329b5-a033-4748-bbf3-f863d3b34267 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:50.829600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043d87d-5f60-42e0-a96c-685056f8cf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:50.830247 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043d87d-5f60-42e0-a96c-685056f8cf7c None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:50.830774 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043d87d-5f60-42e0-a96c-685056f8cf7c None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:50.831098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043d87d-5f60-42e0-a96c-685056f8cf7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:50.843072 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043d87d-5f60-42e0-a96c-685056f8cf7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:25:50.847822 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-a043d87d-5f60-42e0-a96c-685056f8cf7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:25:50.847822 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:25:50.847822 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:25:50.847822 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:25:50.847822 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:25:50.847822 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:25:50.847822 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:25:50.847822 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:25:50.847822 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:25:50.847822 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:25:50.847822 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:25:50.847822 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:25:50.847822 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:25:50.847822 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:25:50.847822 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:25:50.847822 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:25:50.848754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:25:50.848754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:25:50.848754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:25:50.848754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:25:50.848754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:25:50.848754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:25:50.848754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:25:50.848754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:25:50.848754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:25:50.848754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:25:50.848754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:25:50.848754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:25:50.848754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:25:50.848754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:25:50.848754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:25:50.848754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:25:50.849542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:25:50.849542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:25:50.849542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:25:50.849542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:25:50.849542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:25:50.849542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:25:50.849542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:25:50.849542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:25:50.849542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:25:50.849542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:25:50.849542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:25:50.849542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:25:50.852771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 131/251] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 22 20:25:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:25:50.855808 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043d87d-5f60-42e0-a96c-685056f8cf7c None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:50.939335 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:51.002185 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee329b5-a033-4748-bbf3-f863d3b34267 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:51.039365 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21b4de-392e-4e4a-b271-c1d5ff719ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:51.040007 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21b4de-392e-4e4a-b271-c1d5ff719ded None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:51.040289 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21b4de-392e-4e4a-b271-c1d5ff719ded None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:51.040563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21b4de-392e-4e4a-b271-c1d5ff719ded None admin] PATH_INFO: `/v3/roles/member` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:51.051805 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21b4de-392e-4e4a-b271-c1d5ff719ded None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:25:51.057425 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-fc21b4de-392e-4e4a-b271-c1d5ff719ded None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:25:51.057425 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:25:51.057425 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:25:51.057425 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:25:51.057425 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:25:51.057425 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:25:51.057425 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:25:51.057425 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:25:51.057425 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:25:51.057425 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:25:51.057425 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:25:51.057425 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:25:51.057425 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:25:51.057425 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:25:51.057425 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:25:51.057425 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:25:51.058323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:25:51.058323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:25:51.058323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:25:51.058323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:25:51.058323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:25:51.058323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:25:51.058323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:25:51.058323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:25:51.058323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:25:51.058323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:25:51.058323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:25:51.058323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:25:51.058323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:25:51.058323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:25:51.058323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:25:51.058323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:25:51.059102 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:25:51.059102 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:25:51.059102 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:25:51.059102 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:25:51.059102 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:25:51.059102 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:25:51.059102 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:25:51.059102 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:25:51.059102 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:25:51.059102 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:25:51.059102 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:25:51.059102 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:25:51.059102 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 121/252] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:25:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:25:51.060228 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260e820-6958-48c5-b750-bd2b3d5c8ee0 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:51.060322 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260e820-6958-48c5-b750-bd2b3d5c8ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:51.060637 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260e820-6958-48c5-b750-bd2b3d5c8ee0 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:51.066150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 122/253] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:51.067641 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260e820-6958-48c5-b750-bd2b3d5c8ee0 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:51.158811 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043d87d-5f60-42e0-a96c-685056f8cf7c None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:51.187106 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0260e820-6958-48c5-b750-bd2b3d5c8ee0 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:51.223683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84423a03-3549-4171-8643-56b8558542d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:51.224293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84423a03-3549-4171-8643-56b8558542d4 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:51.224580 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84423a03-3549-4171-8643-56b8558542d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:51.224881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84423a03-3549-4171-8643-56b8558542d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:51.225555 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84423a03-3549-4171-8643-56b8558542d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:51.225853 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84423a03-3549-4171-8643-56b8558542d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:51.228482 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84423a03-3549-4171-8643-56b8558542d4 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:51.238318 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 132/254] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:25:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:25:51.240215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:51.241094 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10902b4-25d2-4d51-afce-42723b01521f None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:51.241385 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10902b4-25d2-4d51-afce-42723b01521f None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:51.241665 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10902b4-25d2-4d51-afce-42723b01521f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:51.260484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a108ab-5cc0-4472-a26e-cd6bec436975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:51.260484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a108ab-5cc0-4472-a26e-cd6bec436975 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:51.260484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a108ab-5cc0-4472-a26e-cd6bec436975 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:51.260484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a108ab-5cc0-4472-a26e-cd6bec436975 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:51.260873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a108ab-5cc0-4472-a26e-cd6bec436975 None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:51.260873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a108ab-5cc0-4472-a26e-cd6bec436975 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:51.260873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a108ab-5cc0-4472-a26e-cd6bec436975 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:51.269862 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-d10902b4-25d2-4d51-afce-42723b01521f None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:51.271127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-d10902b4-25d2-4d51-afce-42723b01521f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:51.286341 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 123/255] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 22 20:25:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:25:51.287208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a108ab-5cc0-4472-a26e-cd6bec436975 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:51.323746 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:51.414382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a108ab-5cc0-4472-a26e-cd6bec436975 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:51.449006 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 133/256] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:25:51.450186 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10902b4-25d2-4d51-afce-42723b01521f None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:51.452508 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32a4c9-c239-4910-8e79-9dd5f532bc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:51.453320 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32a4c9-c239-4910-8e79-9dd5f532bc56 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:51.453653 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32a4c9-c239-4910-8e79-9dd5f532bc56 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:51.453925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32a4c9-c239-4910-8e79-9dd5f532bc56 None admin] PATH_INFO: `/v3/users/fbd8426c4c9647ba87d731f863f22708` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:51.463633 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32a4c9-c239-4910-8e79-9dd5f532bc56 None admin] RBAC: Authorizing `identity:get_user(user_id=fbd8426c4c9647ba87d731f863f22708)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:51.465133 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32a4c9-c239-4910-8e79-9dd5f532bc56 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:51.467054 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 124/257] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:25:51 2022] GET /identity/v3/users/fbd8426c4c9647ba87d731f863f22708 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:51.472615 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32a4c9-c239-4910-8e79-9dd5f532bc56 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:51.544117 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:51.582069 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32a4c9-c239-4910-8e79-9dd5f532bc56 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:51.623529 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e202412-406a-44a0-aba3-485c4eb77134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:51.624138 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e202412-406a-44a0-aba3-485c4eb77134 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:51.624414 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e202412-406a-44a0-aba3-485c4eb77134 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:51.626565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e202412-406a-44a0-aba3-485c4eb77134 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:51.733015 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e202412-406a-44a0-aba3-485c4eb77134 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:51.734832 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e202412-406a-44a0-aba3-485c4eb77134 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:51.747607 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10902b4-25d2-4d51-afce-42723b01521f None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:51.814322 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:51.838613 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344883f-d0b6-41bb-8301-73e29a043dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:51.839263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344883f-d0b6-41bb-8301-73e29a043dbd None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:51.839544 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344883f-d0b6-41bb-8301-73e29a043dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:51.839817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344883f-d0b6-41bb-8301-73e29a043dbd None admin] PATH_INFO: `/v3/users/e7e85dbb3ff0449aa9335f9ecea3491c` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:51.841005 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344883f-d0b6-41bb-8301-73e29a043dbd None admin] RBAC: Authorizing `identity:get_user(user_id=e7e85dbb3ff0449aa9335f9ecea3491c)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:51.842470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344883f-d0b6-41bb-8301-73e29a043dbd None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:51.844482 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 134/258] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:25:51 2022] GET /identity/v3/users/e7e85dbb3ff0449aa9335f9ecea3491c => generated 297 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:51.845284 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344883f-d0b6-41bb-8301-73e29a043dbd None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:51.880130 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:51.904196 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 125/259] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:25:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 20:25:51.905024 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e202412-406a-44a0-aba3-485c4eb77134 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:51.968552 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344883f-d0b6-41bb-8301-73e29a043dbd None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:52.010895 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d3e4d-12a9-4380-9767-38bc393d5fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:52.011998 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d3e4d-12a9-4380-9767-38bc393d5fed None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:52.012492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d3e4d-12a9-4380-9767-38bc393d5fed None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:52.013377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d3e4d-12a9-4380-9767-38bc393d5fed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:52.026191 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d3e4d-12a9-4380-9767-38bc393d5fed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:25:52.032024 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-629d3e4d-12a9-4380-9767-38bc393d5fed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:25:52.032024 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:25:52.032024 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:25:52.032024 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:25:52.032024 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:25:52.032024 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:25:52.032024 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:25:52.032024 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:25:52.032024 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:25:52.032024 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:25:52.032024 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:25:52.032024 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:25:52.032024 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:25:52.032024 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:25:52.032024 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:25:52.032024 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:25:52.032967 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:25:52.032967 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:25:52.032967 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:25:52.032967 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:25:52.032967 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:25:52.032967 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:25:52.032967 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:25:52.032967 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:25:52.032967 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:25:52.032967 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:25:52.032967 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:25:52.032967 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:25:52.032967 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:25:52.032967 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:25:52.032967 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:25:52.032967 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:25:52.033756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:25:52.033756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:25:52.033756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:25:52.033756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:25:52.033756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:25:52.033756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:25:52.033756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:25:52.033756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:25:52.033756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:25:52.033756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:25:52.033756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:25:52.033756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:25:52.037793 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 135/260] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 22 20:25:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:25:52.040270 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d3e4d-12a9-4380-9767-38bc393d5fed None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:52.138625 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e202412-406a-44a0-aba3-485c4eb77134 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:52.184292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:52.202369 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139aa5b-9ac1-4251-96e4-00ee68424b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:52.203009 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139aa5b-9ac1-4251-96e4-00ee68424b33 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:52.203291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139aa5b-9ac1-4251-96e4-00ee68424b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:52.204376 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139aa5b-9ac1-4251-96e4-00ee68424b33 None admin] PATH_INFO: `/v3/projects/d0af86473fde40a2b26933e4ecd0901a` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:52.205377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139aa5b-9ac1-4251-96e4-00ee68424b33 None admin] RBAC: Authorizing `identity:get_project(project_id=d0af86473fde40a2b26933e4ecd0901a)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:52.207119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139aa5b-9ac1-4251-96e4-00ee68424b33 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:52.208787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 126/261] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:25:51 2022] GET /identity/v3/projects/d0af86473fde40a2b26933e4ecd0901a => generated 302 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:52.209562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139aa5b-9ac1-4251-96e4-00ee68424b33 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:52.213092 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d3e4d-12a9-4380-9767-38bc393d5fed None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:52.266026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:52.267874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4439e38-53bb-4210-82b8-8292c6415298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:52.268566 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4439e38-53bb-4210-82b8-8292c6415298 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:52.268889 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4439e38-53bb-4210-82b8-8292c6415298 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:52.269166 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4439e38-53bb-4210-82b8-8292c6415298 None admin] PATH_INFO: `/v3/projects/d0af86473fde40a2b26933e4ecd0901a` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:52.270303 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4439e38-53bb-4210-82b8-8292c6415298 None admin] RBAC: Authorizing `identity:get_project(project_id=d0af86473fde40a2b26933e4ecd0901a)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:52.271830 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4439e38-53bb-4210-82b8-8292c6415298 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:52.274128 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 136/262] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:25:52 2022] GET /identity/v3/projects/d0af86473fde40a2b26933e4ecd0901a => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:52.275050 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4439e38-53bb-4210-82b8-8292c6415298 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:52.387563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139aa5b-9ac1-4251-96e4-00ee68424b33 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:52.447573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4439e38-53bb-4210-82b8-8292c6415298 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:52.452343 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599dfc4-ec15-4d4a-8724-95ea78b1b31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:52.453149 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599dfc4-ec15-4d4a-8724-95ea78b1b31e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:52.453374 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599dfc4-ec15-4d4a-8724-95ea78b1b31e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:52.453645 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599dfc4-ec15-4d4a-8724-95ea78b1b31e None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:52.454371 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599dfc4-ec15-4d4a-8724-95ea78b1b31e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:52.457238 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599dfc4-ec15-4d4a-8724-95ea78b1b31e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:52.457238 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599dfc4-ec15-4d4a-8724-95ea78b1b31e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:52.472945 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 127/263] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:25:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:52.472945 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599dfc4-ec15-4d4a-8724-95ea78b1b31e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:52.515202 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66105051-36f2-4176-9d13-573582fbd0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:52.516137 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66105051-36f2-4176-9d13-573582fbd0b6 None admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:52.516561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66105051-36f2-4176-9d13-573582fbd0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:52.517007 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66105051-36f2-4176-9d13-573582fbd0b6 None admin] PATH_INFO: `/v3/projects/d0af86473fde40a2b26933e4ecd0901a/users/e7e85dbb3ff0449aa9335f9ecea3491c/roles/028945f544094c26933c8ef60a480e9a` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:52.521937 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66105051-36f2-4176-9d13-573582fbd0b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0af86473fde40a2b26933e4ecd0901a, user_id=e7e85dbb3ff0449aa9335f9ecea3491c, role_id=028945f544094c26933c8ef60a480e9a)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:52.523655 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66105051-36f2-4176-9d13-573582fbd0b6 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:52.579012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:52.589689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599dfc4-ec15-4d4a-8724-95ea78b1b31e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:52.627261 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1ef7f-d490-4f62-a4ee-b39e447a0759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:52.627927 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1ef7f-d490-4f62-a4ee-b39e447a0759 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:52.628213 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1ef7f-d490-4f62-a4ee-b39e447a0759 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:52.628489 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1ef7f-d490-4f62-a4ee-b39e447a0759 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:52.629285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1ef7f-d490-4f62-a4ee-b39e447a0759 None admin] RBAC: Adding query filter params (role.id=e3faa0474c054da6bb4d8910a4e40bff, scope.project.id=d0af86473fde40a2b26933e4ecd0901a, user.id=fbd8426c4c9647ba87d731f863f22708) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:52.629595 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1ef7f-d490-4f62-a4ee-b39e447a0759 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:52.630908 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 137/264] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 22 20:25:52 2022] PUT /identity/v3/projects/d0af86473fde40a2b26933e4ecd0901a/users/e7e85dbb3ff0449aa9335f9ecea3491c/roles/028945f544094c26933c8ef60a480e9a => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:25:52.631131 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1ef7f-d490-4f62-a4ee-b39e447a0759 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:52.632147 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66105051-36f2-4176-9d13-573582fbd0b6 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:52.638409 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 128/265] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:25:52 2022] GET /identity/v3/role_assignments?user.id=fbd8426c4c9647ba87d731f863f22708&scope.project.id=d0af86473fde40a2b26933e4ecd0901a&role.id=e3faa0474c054da6bb4d8910a4e40bff => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:52.665028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:52.776724 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66105051-36f2-4176-9d13-573582fbd0b6 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:52.817361 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b295214f-a1e2-4d08-8f50-fa65f34899cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:52.818009 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295214f-a1e2-4d08-8f50-fa65f34899cf None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:52.818285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295214f-a1e2-4d08-8f50-fa65f34899cf None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:52.818556 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b295214f-a1e2-4d08-8f50-fa65f34899cf None admin] PATH_INFO: `/v3/users/fbd8426c4c9647ba87d731f863f22708` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:52.819729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b295214f-a1e2-4d08-8f50-fa65f34899cf None admin] RBAC: Authorizing `identity:get_user(user_id=fbd8426c4c9647ba87d731f863f22708)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:52.821281 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b295214f-a1e2-4d08-8f50-fa65f34899cf None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:52.823109 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 138/266] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:25:52 2022] GET /identity/v3/users/fbd8426c4c9647ba87d731f863f22708 => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:52.829041 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1ef7f-d490-4f62-a4ee-b39e447a0759 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:52.968341 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1ef7f-d490-4f62-a4ee-b39e447a0759 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:53.009659 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6fa98-d066-415b-91a7-3ab6798e0a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:53.010330 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6fa98-d066-415b-91a7-3ab6798e0a3c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:53.010771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6fa98-d066-415b-91a7-3ab6798e0a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:53.010847 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6fa98-d066-415b-91a7-3ab6798e0a3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:53.034359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9a268-4556-4d0b-ab76-6a75bef35978 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:53.034837 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9a268-4556-4d0b-ab76-6a75bef35978 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:53.034837 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9a268-4556-4d0b-ab76-6a75bef35978 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:53.036274 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 139/267] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:53.042254 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654f94c-f46c-42bf-996a-7fad201edec4 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:53.042534 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654f94c-f46c-42bf-996a-7fad201edec4 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:53.042809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654f94c-f46c-42bf-996a-7fad201edec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:53.057030 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:53.077959 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-4654f94c-f46c-42bf-996a-7fad201edec4 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:53.083739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-4654f94c-f46c-42bf-996a-7fad201edec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:53.095445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6fa98-d066-415b-91a7-3ab6798e0a3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:53.097284 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6fa98-d066-415b-91a7-3ab6798e0a3c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:53.218454 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 129/268] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:25:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:25:53.219836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00bef9-e2ba-4901-8cc5-d06ba5a8711b None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:53.220132 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00bef9-e2ba-4901-8cc5-d06ba5a8711b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:53.220397 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00bef9-e2ba-4901-8cc5-d06ba5a8711b None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:53.221327 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 140/269] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:25:53.224759 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 130/270] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:53.225884 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654f94c-f46c-42bf-996a-7fad201edec4 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:53.234015 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9bba6-00d7-4c74-b7a8-a5e700d3f659 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:53.234298 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9bba6-00d7-4c74-b7a8-a5e700d3f659 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:53.234576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9bba6-00d7-4c74-b7a8-a5e700d3f659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:53.244786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:53.275221 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-7cf9bba6-00d7-4c74-b7a8-a5e700d3f659 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:53.276486 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7cf9bba6-00d7-4c74-b7a8-a5e700d3f659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:53.365772 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:53.404864 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 131/271] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:25:53.405156 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654f94c-f46c-42bf-996a-7fad201edec4 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:53.445187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04e8d6-9fe8-4c01-8776-409cb9031817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:53.445922 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04e8d6-9fe8-4c01-8776-409cb9031817 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:53.446248 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04e8d6-9fe8-4c01-8776-409cb9031817 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:53.446520 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04e8d6-9fe8-4c01-8776-409cb9031817 None admin] PATH_INFO: `/v3/projects/d0af86473fde40a2b26933e4ecd0901a` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:53.447669 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04e8d6-9fe8-4c01-8776-409cb9031817 None admin] RBAC: Authorizing `identity:get_project(project_id=d0af86473fde40a2b26933e4ecd0901a)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:53.449172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04e8d6-9fe8-4c01-8776-409cb9031817 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:53.450866 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 141/272] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:25:53 2022] GET /identity/v3/projects/d0af86473fde40a2b26933e4ecd0901a => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:53.456901 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbcf93-3846-4ba6-80d4-b2b9b9214258 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:53.457137 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04e8d6-9fe8-4c01-8776-409cb9031817 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:53.457234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbcf93-3846-4ba6-80d4-b2b9b9214258 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:53.457504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbcf93-3846-4ba6-80d4-b2b9b9214258 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:53.459141 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 132/273] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:53.464753 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd739f0e-43cd-4e88-b79e-20d55035c6ba None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:53.465041 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd739f0e-43cd-4e88-b79e-20d55035c6ba None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:53.465319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd739f0e-43cd-4e88-b79e-20d55035c6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:53.484035 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-dd739f0e-43cd-4e88-b79e-20d55035c6ba None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:53.485266 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-dd739f0e-43cd-4e88-b79e-20d55035c6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:53.566621 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:53.601782 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04e8d6-9fe8-4c01-8776-409cb9031817 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:53.615303 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 133/274] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:25:53.620941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd739f0e-43cd-4e88-b79e-20d55035c6ba None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:53.666175 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37737d-ee9d-4684-b69e-635750377de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:53.666792 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37737d-ee9d-4684-b69e-635750377de7 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:53.667095 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37737d-ee9d-4684-b69e-635750377de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:53.667565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37737d-ee9d-4684-b69e-635750377de7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:53.669270 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37737d-ee9d-4684-b69e-635750377de7 None admin] RBAC: Adding query filter params (role.id=7f4b8cdb739c4f808ef31961eb11510e, scope.project.id=d0af86473fde40a2b26933e4ecd0901a, user.id=fbd8426c4c9647ba87d731f863f22708) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:53.669584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37737d-ee9d-4684-b69e-635750377de7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:53.671732 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37737d-ee9d-4684-b69e-635750377de7 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:53.685907 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 142/275] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:25:53 2022] GET /identity/v3/role_assignments?user.id=fbd8426c4c9647ba87d731f863f22708&scope.project.id=d0af86473fde40a2b26933e4ecd0901a&role.id=7f4b8cdb739c4f808ef31961eb11510e => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:25:53.737822 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37737d-ee9d-4684-b69e-635750377de7 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:53.813628 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd739f0e-43cd-4e88-b79e-20d55035c6ba None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:53.833035 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:53.884488 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35958fd-f39d-4933-ab78-45b1d60a0856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:53.884488 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35958fd-f39d-4933-ab78-45b1d60a0856 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:53.884764 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35958fd-f39d-4933-ab78-45b1d60a0856 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:53.885047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35958fd-f39d-4933-ab78-45b1d60a0856 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:53.908853 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35958fd-f39d-4933-ab78-45b1d60a0856 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:25:53.914701 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-a35958fd-f39d-4933-ab78-45b1d60a0856 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:25:53.914701 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:25:53.914701 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:25:53.914701 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:25:53.914701 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:25:53.914701 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:25:53.914701 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:25:53.914701 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:25:53.914701 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:25:53.914701 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:25:53.914701 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:25:53.914701 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:25:53.914701 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:25:53.914701 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:25:53.914701 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:25:53.914701 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:25:53.915803 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:25:53.915803 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:25:53.915803 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:25:53.915803 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:25:53.915803 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:25:53.915803 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:25:53.915803 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:25:53.915803 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:25:53.915803 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:25:53.915803 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:25:53.915803 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:25:53.915803 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:25:53.915803 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:25:53.915803 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:25:53.915803 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:25:53.915803 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:25:53.916643 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:25:53.916643 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:25:53.916643 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:25:53.916643 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:25:53.916643 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:25:53.916643 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:25:53.916643 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:25:53.916643 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:25:53.916643 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:25:53.916643 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:25:53.916643 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:25:53.916643 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:25:53.924760 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 134/276] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:25:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:25:53.924927 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37737d-ee9d-4684-b69e-635750377de7 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:53.927671 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35958fd-f39d-4933-ab78-45b1d60a0856 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:53.961674 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3432d6a-74ea-4a74-8bf9-76156c4d2c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:53.962305 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3432d6a-74ea-4a74-8bf9-76156c4d2c61 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:53.962589 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3432d6a-74ea-4a74-8bf9-76156c4d2c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:53.962863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3432d6a-74ea-4a74-8bf9-76156c4d2c61 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:53.977891 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3432d6a-74ea-4a74-8bf9-76156c4d2c61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:25:53.983104 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-c3432d6a-74ea-4a74-8bf9-76156c4d2c61 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:25:53.983104 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:25:53.983104 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:25:53.983104 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:25:53.983104 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:25:53.983104 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:25:53.983104 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:25:53.983104 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:25:53.983104 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:25:53.983104 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:25:53.983104 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:25:53.983104 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:25:53.983104 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:25:53.983104 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:25:53.983104 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:25:53.983104 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:25:53.983970 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:25:53.983970 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:25:53.983970 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:25:53.983970 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:25:53.983970 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:25:53.983970 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:25:53.983970 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:25:53.983970 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:25:53.983970 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:25:53.983970 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:25:53.983970 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:25:53.983970 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:25:53.983970 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:25:53.983970 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:25:53.983970 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:25:53.983970 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:25:53.985158 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:25:53.985158 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:25:53.985158 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:25:53.985158 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:25:53.985158 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:25:53.985158 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:25:53.985158 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:25:53.985158 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:25:53.985158 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:25:53.985158 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:25:53.985158 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:25:53.985158 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:25:53.985158 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 143/277] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:25:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:25:53.985158 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3432d6a-74ea-4a74-8bf9-76156c4d2c61 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:53.992688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:54.057326 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35958fd-f39d-4933-ab78-45b1d60a0856 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:54.096281 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a4d09-a8a4-4469-b24a-c847ceca445c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:54.096916 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a4d09-a8a4-4469-b24a-c847ceca445c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:54.097200 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a4d09-a8a4-4469-b24a-c847ceca445c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:54.097478 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a4d09-a8a4-4469-b24a-c847ceca445c None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:54.098144 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a4d09-a8a4-4469-b24a-c847ceca445c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:54.098549 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a4d09-a8a4-4469-b24a-c847ceca445c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:54.099871 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a4d09-a8a4-4469-b24a-c847ceca445c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:54.109025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3432d6a-74ea-4a74-8bf9-76156c4d2c61 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:54.109704 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 135/278] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 22 20:25:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:25:54.110529 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a4d09-a8a4-4469-b24a-c847ceca445c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:54.144355 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:54.159850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092986c-c60b-4b2e-95f6-0903faaf94ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:54.161013 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092986c-c60b-4b2e-95f6-0903faaf94ab None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:54.161652 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092986c-c60b-4b2e-95f6-0903faaf94ab None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:54.162023 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092986c-c60b-4b2e-95f6-0903faaf94ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:54.163407 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092986c-c60b-4b2e-95f6-0903faaf94ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:54.165912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092986c-c60b-4b2e-95f6-0903faaf94ab None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:54.173324 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 144/279] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:25:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:54.174875 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092986c-c60b-4b2e-95f6-0903faaf94ab None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:54.220253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a4d09-a8a4-4469-b24a-c847ceca445c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:54.251522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:54.259299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce3a73-1417-4d25-a478-74404da4b719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:54.259914 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce3a73-1417-4d25-a478-74404da4b719 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:54.260195 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce3a73-1417-4d25-a478-74404da4b719 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:54.260467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce3a73-1417-4d25-a478-74404da4b719 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:54.261173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce3a73-1417-4d25-a478-74404da4b719 None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:54.261477 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce3a73-1417-4d25-a478-74404da4b719 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:54.262864 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce3a73-1417-4d25-a478-74404da4b719 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:54.276719 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 136/280] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 22 20:25:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:54.276719 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce3a73-1417-4d25-a478-74404da4b719 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:54.289695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092986c-c60b-4b2e-95f6-0903faaf94ab None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:54.325007 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c42c19-0464-4247-90d1-7170455f6f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:54.325711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c42c19-0464-4247-90d1-7170455f6f3c None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:54.326089 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c42c19-0464-4247-90d1-7170455f6f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:54.326429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c42c19-0464-4247-90d1-7170455f6f3c None admin] PATH_INFO: `/v3/users/f43b9bfda4084fe39670022a6945abff` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:54.327652 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c42c19-0464-4247-90d1-7170455f6f3c None admin] RBAC: Authorizing `identity:get_user(user_id=f43b9bfda4084fe39670022a6945abff)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:54.329202 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c42c19-0464-4247-90d1-7170455f6f3c None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:54.336016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 145/281] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:25:54 2022] GET /identity/v3/users/f43b9bfda4084fe39670022a6945abff => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:54.336016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c42c19-0464-4247-90d1-7170455f6f3c None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:54.377965 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:54.385822 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce3a73-1417-4d25-a478-74404da4b719 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:54.421098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae470f73-675f-41e0-953e-2285e4778ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:54.421617 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae470f73-675f-41e0-953e-2285e4778ef2 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:54.421891 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae470f73-675f-41e0-953e-2285e4778ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:54.422160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae470f73-675f-41e0-953e-2285e4778ef2 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:54.422850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae470f73-675f-41e0-953e-2285e4778ef2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:54.424502 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae470f73-675f-41e0-953e-2285e4778ef2 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:54.441035 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c42c19-0464-4247-90d1-7170455f6f3c None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:54.475009 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de2c93-160f-4706-a1ff-1205caaa1b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:54.475636 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de2c93-160f-4706-a1ff-1205caaa1b0c None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:54.475919 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de2c93-160f-4706-a1ff-1205caaa1b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:54.476785 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de2c93-160f-4706-a1ff-1205caaa1b0c None admin] PATH_INFO: `/v3/users/5d427682991144899fae27d915cd01cd` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:54.488032 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:54.491269 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de2c93-160f-4706-a1ff-1205caaa1b0c None admin] RBAC: Authorizing `identity:get_user(user_id=5d427682991144899fae27d915cd01cd)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:54.492989 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de2c93-160f-4706-a1ff-1205caaa1b0c None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:54.494588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 146/282] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:25:54 2022] GET /identity/v3/users/5d427682991144899fae27d915cd01cd => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:54.495347 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de2c93-160f-4706-a1ff-1205caaa1b0c None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:54.556923 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 137/283] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Aug 22 20:25:54 2022] POST /identity/v3/users => generated 293 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:25:54.556923 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae470f73-675f-41e0-953e-2285e4778ef2 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:54.615836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de2c93-160f-4706-a1ff-1205caaa1b0c None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:54.669847 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3d3fc-790d-4ff8-9560-a2ab12ab3a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:54.671003 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3d3fc-790d-4ff8-9560-a2ab12ab3a33 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:54.671492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3d3fc-790d-4ff8-9560-a2ab12ab3a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:54.672185 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3d3fc-790d-4ff8-9560-a2ab12ab3a33 None admin] PATH_INFO: `/v3/projects/d0af86473fde40a2b26933e4ecd0901a` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:54.674109 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d3d3fc-790d-4ff8-9560-a2ab12ab3a33 None admin] RBAC: Authorizing `identity:get_project(project_id=d0af86473fde40a2b26933e4ecd0901a)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:54.675778 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d3d3fc-790d-4ff8-9560-a2ab12ab3a33 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:54.679097 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 147/284] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:25:54 2022] GET /identity/v3/projects/d0af86473fde40a2b26933e4ecd0901a => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:54.685358 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3d3fc-790d-4ff8-9560-a2ab12ab3a33 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:54.697603 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae470f73-675f-41e0-953e-2285e4778ef2 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:54.745117 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a8950-27d0-479b-91d4-65178455e2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:54.745932 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a8950-27d0-479b-91d4-65178455e2c0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:54.746311 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a8950-27d0-479b-91d4-65178455e2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:54.746702 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a8950-27d0-479b-91d4-65178455e2c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:54.747437 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a8950-27d0-479b-91d4-65178455e2c0 None admin] RBAC: Adding query filter params (role.id=028945f544094c26933c8ef60a480e9a, user.id=5d427682991144899fae27d915cd01cd, scope.system=all) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:54.747748 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a8950-27d0-479b-91d4-65178455e2c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:54.749456 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a8950-27d0-479b-91d4-65178455e2c0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:54.756120 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 138/285] 10.222.0.62 () {56 vars in 1308 bytes} [Mon Aug 22 20:25:54 2022] GET /identity/v3/role_assignments?user.id=5d427682991144899fae27d915cd01cd&scope.system=all&role.id=028945f544094c26933c8ef60a480e9a => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:54.775957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:54.821954 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3d3fc-790d-4ff8-9560-a2ab12ab3a33 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:54.863433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfed8e-c6ef-430a-9863-1ee8dc9c4dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:54.864104 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfed8e-c6ef-430a-9863-1ee8dc9c4dfe None admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:54.864386 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfed8e-c6ef-430a-9863-1ee8dc9c4dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:54.864688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfed8e-c6ef-430a-9863-1ee8dc9c4dfe None admin] PATH_INFO: `/v3/projects/d0af86473fde40a2b26933e4ecd0901a/users/f43b9bfda4084fe39670022a6945abff/roles/c1ddd6c095d041d4a18c8cf126582891` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:54.866768 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfed8e-c6ef-430a-9863-1ee8dc9c4dfe None admin] RBAC: Authorizing `identity:create_grant(project_id=d0af86473fde40a2b26933e4ecd0901a, user_id=f43b9bfda4084fe39670022a6945abff, role_id=c1ddd6c095d041d4a18c8cf126582891)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:54.868314 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfed8e-c6ef-430a-9863-1ee8dc9c4dfe None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:54.946555 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 148/286] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 22 20:25:54 2022] PUT /identity/v3/projects/d0af86473fde40a2b26933e4ecd0901a/users/f43b9bfda4084fe39670022a6945abff/roles/c1ddd6c095d041d4a18c8cf126582891 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:25:55.039314 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bd9c7-707d-4b48-a232-63c4c5c68661 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:55.039544 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bd9c7-707d-4b48-a232-63c4c5c68661 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:55.039686 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bd9c7-707d-4b48-a232-63c4c5c68661 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:55.041148 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 139/287] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:55.046975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ece821-7853-437e-90ab-ff8fbc6d7bcd None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:55.047591 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ece821-7853-437e-90ab-ff8fbc6d7bcd None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:55.048054 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ece821-7853-437e-90ab-ff8fbc6d7bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:55.072419 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-70ece821-7853-437e-90ab-ff8fbc6d7bcd None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:55.074061 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-70ece821-7853-437e-90ab-ff8fbc6d7bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:55.148972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 149/288] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:25:55.431681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361bd9c7-707d-4b48-a232-63c4c5c68661 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:55.452707 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:55.567278 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361bd9c7-707d-4b48-a232-63c4c5c68661 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:55.610263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517248b-5145-480f-abd8-d3979e3b89c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:55.610894 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517248b-5145-480f-abd8-d3979e3b89c7 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:55.611170 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517248b-5145-480f-abd8-d3979e3b89c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:55.611439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517248b-5145-480f-abd8-d3979e3b89c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:55.625976 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517248b-5145-480f-abd8-d3979e3b89c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:25:55.631182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-0517248b-5145-480f-abd8-d3979e3b89c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:25:55.631182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:25:55.631182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:25:55.631182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:25:55.631182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:25:55.631182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:25:55.631182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:25:55.631182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:25:55.631182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:25:55.631182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:25:55.631182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:25:55.631182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:25:55.631182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:25:55.631182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:25:55.631182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:25:55.631182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:25:55.632045 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:25:55.632045 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:25:55.632045 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:25:55.632045 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:25:55.632045 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:25:55.632045 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:25:55.632045 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:25:55.632045 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:25:55.632045 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:25:55.632045 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:25:55.632045 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:25:55.632045 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:25:55.632045 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:25:55.632045 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:25:55.632045 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:25:55.632045 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:25:55.633356 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:25:55.633356 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:25:55.633356 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:25:55.633356 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:25:55.633356 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:25:55.633356 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:25:55.633356 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:25:55.633356 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:25:55.633356 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:25:55.633356 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:25:55.633356 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:25:55.633356 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:25:55.633356 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 140/289] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:25:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:25:55.638501 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ece821-7853-437e-90ab-ff8fbc6d7bcd None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:55.715162 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:55.807937 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ece821-7853-437e-90ab-ff8fbc6d7bcd None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:55.850694 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3460e-977f-46be-a7de-332e3e8a46db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:55.852010 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3460e-977f-46be-a7de-332e3e8a46db None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:55.852295 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3460e-977f-46be-a7de-332e3e8a46db None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:55.852687 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3460e-977f-46be-a7de-332e3e8a46db None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:55.853362 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3460e-977f-46be-a7de-332e3e8a46db None admin] RBAC: Adding query filter params (name=member) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:55.853660 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3460e-977f-46be-a7de-332e3e8a46db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:55.855030 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3460e-977f-46be-a7de-332e3e8a46db None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:55.867223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 150/290] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 22 20:25:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:55.872914 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517248b-5145-480f-abd8-d3979e3b89c7 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:55.965531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:56.000062 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517248b-5145-480f-abd8-d3979e3b89c7 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:56.048473 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1092bba-e5f0-41b1-b865-c85824607008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:56.049156 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1092bba-e5f0-41b1-b865-c85824607008 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:56.049433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1092bba-e5f0-41b1-b865-c85824607008 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:56.049701 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1092bba-e5f0-41b1-b865-c85824607008 None admin] PATH_INFO: `/v3/users/e7e85dbb3ff0449aa9335f9ecea3491c` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:56.051523 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1092bba-e5f0-41b1-b865-c85824607008 None admin] RBAC: Authorizing `identity:get_user(user_id=e7e85dbb3ff0449aa9335f9ecea3491c)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:56.053019 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1092bba-e5f0-41b1-b865-c85824607008 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:56.055028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 141/291] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:25:55 2022] GET /identity/v3/users/e7e85dbb3ff0449aa9335f9ecea3491c => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:56.060887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3460e-977f-46be-a7de-332e3e8a46db None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:56.192602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3460e-977f-46be-a7de-332e3e8a46db None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:56.216172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:56.243102 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d502e-c082-4699-a0d8-197844f6946c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:56.243712 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d502e-c082-4699-a0d8-197844f6946c None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:56.243987 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d502e-c082-4699-a0d8-197844f6946c None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:56.244255 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d502e-c082-4699-a0d8-197844f6946c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:56.328870 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d502e-c082-4699-a0d8-197844f6946c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:56.330586 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d502e-c082-4699-a0d8-197844f6946c None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:56.457787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 151/292] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:25:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:25:56.470465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1092bba-e5f0-41b1-b865-c85824607008 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:56.711923 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1092bba-e5f0-41b1-b865-c85824607008 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:56.769115 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1876f5-18ac-4a7a-9bf3-dcf23a7294ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:56.770063 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1876f5-18ac-4a7a-9bf3-dcf23a7294ff None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:56.770547 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1876f5-18ac-4a7a-9bf3-dcf23a7294ff None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:56.771032 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1876f5-18ac-4a7a-9bf3-dcf23a7294ff None admin] PATH_INFO: `/v3/projects/d0af86473fde40a2b26933e4ecd0901a` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:56.773490 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1876f5-18ac-4a7a-9bf3-dcf23a7294ff None admin] RBAC: Authorizing `identity:get_project(project_id=d0af86473fde40a2b26933e4ecd0901a)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:56.775924 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1876f5-18ac-4a7a-9bf3-dcf23a7294ff None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:56.779120 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 142/293] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:25:56 2022] GET /identity/v3/projects/d0af86473fde40a2b26933e4ecd0901a => generated 302 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:56.787524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d502e-c082-4699-a0d8-197844f6946c None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:56.817070 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:56.941157 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d502e-c082-4699-a0d8-197844f6946c None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:56.990782 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753436dd-0c4e-4296-8898-da742eff39e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:56.991659 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753436dd-0c4e-4296-8898-da742eff39e0 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:56.991769 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753436dd-0c4e-4296-8898-da742eff39e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:56.991962 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753436dd-0c4e-4296-8898-da742eff39e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:56.992711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753436dd-0c4e-4296-8898-da742eff39e0 None admin] RBAC: Adding query filter params (role.id=028945f544094c26933c8ef60a480e9a, scope.project.id=d0af86473fde40a2b26933e4ecd0901a, user.id=e7e85dbb3ff0449aa9335f9ecea3491c) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:56.993023 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753436dd-0c4e-4296-8898-da742eff39e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:56.994463 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753436dd-0c4e-4296-8898-da742eff39e0 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:57.003420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 152/294] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:25:56 2022] GET /identity/v3/role_assignments?user.id=e7e85dbb3ff0449aa9335f9ecea3491c&scope.project.id=d0af86473fde40a2b26933e4ecd0901a&role.id=028945f544094c26933c8ef60a480e9a => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:25:57.068812 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770d18d-a7c8-4090-992e-c203e5ba1eba None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:57.069017 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770d18d-a7c8-4090-992e-c203e5ba1eba None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:57.069284 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770d18d-a7c8-4090-992e-c203e5ba1eba None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:57.071420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 143/295] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:57.076770 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdf931-9430-48b6-bc4d-23299a03e673 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:57.077063 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdf931-9430-48b6-bc4d-23299a03e673 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:57.077345 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdf931-9430-48b6-bc4d-23299a03e673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:57.102729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-b7cdf931-9430-48b6-bc4d-23299a03e673 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:57.103949 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b7cdf931-9430-48b6-bc4d-23299a03e673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:57.200509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 153/296] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:25:57.223013 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bdffa-89de-4a51-90d7-974bd33af3cf None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:57.223608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bdffa-89de-4a51-90d7-974bd33af3cf None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:57.224099 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bdffa-89de-4a51-90d7-974bd33af3cf None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:57.226496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 144/297] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:57.232053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bba76-1be9-4547-9a58-5690f86d0b14 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:57.232341 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bba76-1be9-4547-9a58-5690f86d0b14 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:57.232615 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bba76-1be9-4547-9a58-5690f86d0b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:57.248373 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85419b0d-1a11-4a6e-bed9-5844dbf8b8d2 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:57.248971 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85419b0d-1a11-4a6e-bed9-5844dbf8b8d2 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:57.249435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85419b0d-1a11-4a6e-bed9-5844dbf8b8d2 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:57.251190 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 145/298] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:57.255166 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-002bba76-1be9-4547-9a58-5690f86d0b14 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:57.255166 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-002bba76-1be9-4547-9a58-5690f86d0b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:57.256537 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad0db6-68be-4559-bb6b-8335dee9d5d3 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:57.257362 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad0db6-68be-4559-bb6b-8335dee9d5d3 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:57.257850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad0db6-68be-4559-bb6b-8335dee9d5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:57.270208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:57.284003 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-10ad0db6-68be-4559-bb6b-8335dee9d5d3 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:57.285557 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-10ad0db6-68be-4559-bb6b-8335dee9d5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:57.313040 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:57.330046 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 154/299] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:25:57.361697 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 146/300] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:25:57.499812 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bba76-1be9-4547-9a58-5690f86d0b14 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:57.617105 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bba76-1be9-4547-9a58-5690f86d0b14 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:57.619584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad0db6-68be-4559-bb6b-8335dee9d5d3 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:57.654206 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f1fbd-3fa1-42b2-8298-99d04458da34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:57.654843 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f1fbd-3fa1-42b2-8298-99d04458da34 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:57.655133 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f1fbd-3fa1-42b2-8298-99d04458da34 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:57.655389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f1fbd-3fa1-42b2-8298-99d04458da34 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:57.666342 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f1fbd-3fa1-42b2-8298-99d04458da34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:25:57.671066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-b03f1fbd-3fa1-42b2-8298-99d04458da34 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:25:57.671066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:25:57.671066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:25:57.671066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:25:57.671066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:25:57.671066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:25:57.671066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:25:57.671066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:25:57.671066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:25:57.671066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:25:57.671066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:25:57.671066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:25:57.671066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:25:57.671066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:25:57.671066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:25:57.671066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:25:57.671925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:25:57.671925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:25:57.671925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:25:57.671925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:25:57.671925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:25:57.671925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:25:57.671925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:25:57.671925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:25:57.671925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:25:57.671925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:25:57.671925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:25:57.671925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:25:57.671925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:25:57.671925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:25:57.671925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:25:57.671925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:25:57.672739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:25:57.672739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:25:57.672739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:25:57.672739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:25:57.672739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:25:57.672739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:25:57.672739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:25:57.672739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:25:57.672739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:25:57.672739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:25:57.672739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:25:57.672739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:25:57.672739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 155/301] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:25:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:25:57.674290 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f1fbd-3fa1-42b2-8298-99d04458da34 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:57.676627 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:57.738126 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad0db6-68be-4559-bb6b-8335dee9d5d3 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:57.773425 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3182d-28ee-4f72-8050-6eba4cbdff0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:57.774297 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3182d-28ee-4f72-8050-6eba4cbdff0d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:57.774568 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3182d-28ee-4f72-8050-6eba4cbdff0d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:57.774832 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3182d-28ee-4f72-8050-6eba4cbdff0d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:57.775933 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3182d-28ee-4f72-8050-6eba4cbdff0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:57.777410 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3182d-28ee-4f72-8050-6eba4cbdff0d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:57.778962 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 147/302] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:25:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:57.780038 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3182d-28ee-4f72-8050-6eba4cbdff0d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:57.789420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f1fbd-3fa1-42b2-8298-99d04458da34 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:57.795609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:57.828480 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7da4c-af97-46f6-99c2-90e77fbf77d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:57.829136 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7da4c-af97-46f6-99c2-90e77fbf77d1 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:57.829410 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7da4c-af97-46f6-99c2-90e77fbf77d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:57.829676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7da4c-af97-46f6-99c2-90e77fbf77d1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:57.841478 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b7da4c-af97-46f6-99c2-90e77fbf77d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:25:57.847062 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-e8b7da4c-af97-46f6-99c2-90e77fbf77d1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:25:57.847062 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:25:57.847062 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:25:57.847062 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:25:57.847062 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:25:57.847062 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:25:57.847062 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:25:57.847062 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:25:57.847062 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:25:57.847062 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:25:57.847062 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:25:57.847062 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:25:57.847062 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:25:57.847062 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:25:57.847062 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:25:57.847062 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:25:57.847920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:25:57.847920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:25:57.847920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:25:57.847920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:25:57.847920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:25:57.847920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:25:57.847920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:25:57.847920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:25:57.847920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:25:57.847920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:25:57.847920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:25:57.847920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:25:57.847920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:25:57.847920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:25:57.847920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:25:57.847920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:25:57.849401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:25:57.849401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:25:57.849401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:25:57.849401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:25:57.849401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:25:57.849401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:25:57.849401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:25:57.849401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:25:57.849401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:25:57.849401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:25:57.849401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:25:57.849401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:25:57.849401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 156/303] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:25:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:25:57.849401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7da4c-af97-46f6-99c2-90e77fbf77d1 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:57.901275 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3182d-28ee-4f72-8050-6eba4cbdff0d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:57.915028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:57.937739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353911e2-8649-40a7-bfd0-446742a3093a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:57.938344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353911e2-8649-40a7-bfd0-446742a3093a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:57.938619 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353911e2-8649-40a7-bfd0-446742a3093a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:57.938888 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353911e2-8649-40a7-bfd0-446742a3093a None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:57.939540 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353911e2-8649-40a7-bfd0-446742a3093a None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:57.939836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353911e2-8649-40a7-bfd0-446742a3093a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:57.941344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353911e2-8649-40a7-bfd0-446742a3093a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:57.952833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 148/304] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 22 20:25:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:57.952833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353911e2-8649-40a7-bfd0-446742a3093a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:57.954345 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7da4c-af97-46f6-99c2-90e77fbf77d1 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:57.989966 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94694fca-906b-4f8b-995b-1de4e5377126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:57.990569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94694fca-906b-4f8b-995b-1de4e5377126 None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:57.990846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94694fca-906b-4f8b-995b-1de4e5377126 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:57.991116 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94694fca-906b-4f8b-995b-1de4e5377126 None admin] PATH_INFO: `/v3/groups` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:57.991732 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94694fca-906b-4f8b-995b-1de4e5377126 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:57.993200 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94694fca-906b-4f8b-995b-1de4e5377126 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:58.019888 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:58.050440 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353911e2-8649-40a7-bfd0-446742a3093a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:58.067903 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 157/305] 10.222.0.62 () {60 vars in 1134 bytes} [Mon Aug 22 20:25:57 2022] POST /identity/v3/groups => generated 229 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:25:58.069006 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702412b-9b42-42da-acc0-ebb3a0f02a43 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:58.069292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702412b-9b42-42da-acc0-ebb3a0f02a43 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:58.069708 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702412b-9b42-42da-acc0-ebb3a0f02a43 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:58.071558 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 158/306] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:25:58.072132 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702412b-9b42-42da-acc0-ebb3a0f02a43 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:58.096823 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e608a4-2c20-481c-ab61-9cd457aa7711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:58.097454 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e608a4-2c20-481c-ab61-9cd457aa7711 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:58.097764 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e608a4-2c20-481c-ab61-9cd457aa7711 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:58.098126 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e608a4-2c20-481c-ab61-9cd457aa7711 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:58.098728 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e608a4-2c20-481c-ab61-9cd457aa7711 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:58.099036 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e608a4-2c20-481c-ab61-9cd457aa7711 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:58.100470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e608a4-2c20-481c-ab61-9cd457aa7711 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:58.111100 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 149/307] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 22 20:25:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:58.112405 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1cd75-da24-472d-8ed3-55d3ff7f8a6f None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:58.112723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1cd75-da24-472d-8ed3-55d3ff7f8a6f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:58.113006 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1cd75-da24-472d-8ed3-55d3ff7f8a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:58.132912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-6cc1cd75-da24-472d-8ed3-55d3ff7f8a6f None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:25:58.134379 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6cc1cd75-da24-472d-8ed3-55d3ff7f8a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:25:58.197119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702412b-9b42-42da-acc0-ebb3a0f02a43 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:58.207992 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 150/308] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:25:58.208881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1cd75-da24-472d-8ed3-55d3ff7f8a6f None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:58.225397 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:58.246413 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e36c09-3d2a-4d2b-a3a3-57f4e5e6ec2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:58.247121 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e36c09-3d2a-4d2b-a3a3-57f4e5e6ec2d None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:58.248099 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e36c09-3d2a-4d2b-a3a3-57f4e5e6ec2d None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:58.248099 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e36c09-3d2a-4d2b-a3a3-57f4e5e6ec2d None admin] PATH_INFO: `/v3/users/5d427682991144899fae27d915cd01cd` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:58.253423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e36c09-3d2a-4d2b-a3a3-57f4e5e6ec2d None admin] RBAC: Authorizing `identity:get_user(user_id=5d427682991144899fae27d915cd01cd)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:58.255328 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e36c09-3d2a-4d2b-a3a3-57f4e5e6ec2d None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:58.258290 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 159/309] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:25:58 2022] GET /identity/v3/users/5d427682991144899fae27d915cd01cd => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:58.264191 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e36c09-3d2a-4d2b-a3a3-57f4e5e6ec2d None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:58.281861 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:58.332088 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1cd75-da24-472d-8ed3-55d3ff7f8a6f None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:58.368231 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16524ecb-d700-43b2-8d7a-f9eb5b18e337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:58.369105 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16524ecb-d700-43b2-8d7a-f9eb5b18e337 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:58.369510 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16524ecb-d700-43b2-8d7a-f9eb5b18e337 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:58.369949 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16524ecb-d700-43b2-8d7a-f9eb5b18e337 None admin] PATH_INFO: `/v3/users/ce4cca48251f47c396fc68f1eacea52d` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:58.383664 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16524ecb-d700-43b2-8d7a-f9eb5b18e337 None admin] RBAC: Authorizing `identity:get_user(user_id=ce4cca48251f47c396fc68f1eacea52d)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:58.383837 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e36c09-3d2a-4d2b-a3a3-57f4e5e6ec2d None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:58.385495 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16524ecb-d700-43b2-8d7a-f9eb5b18e337 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:58.387301 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 151/310] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:25:58 2022] GET /identity/v3/users/ce4cca48251f47c396fc68f1eacea52d => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:58.393255 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16524ecb-d700-43b2-8d7a-f9eb5b18e337 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:58.419965 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33bd58f-4289-43ed-805e-399bb3d1f4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:58.420618 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bd58f-4289-43ed-805e-399bb3d1f4b2 None admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:58.420960 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bd58f-4289-43ed-805e-399bb3d1f4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:58.421234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bd58f-4289-43ed-805e-399bb3d1f4b2 None admin] PATH_INFO: `/v3/system/users/5d427682991144899fae27d915cd01cd/roles/028945f544094c26933c8ef60a480e9a` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:58.422640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33bd58f-4289-43ed-805e-399bb3d1f4b2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5d427682991144899fae27d915cd01cd, role_id=028945f544094c26933c8ef60a480e9a)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:58.424010 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33bd58f-4289-43ed-805e-399bb3d1f4b2 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:58.503074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16524ecb-d700-43b2-8d7a-f9eb5b18e337 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:58.516701 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 160/311] 10.222.0.62 () {58 vars in 1334 bytes} [Mon Aug 22 20:25:58 2022] PUT /identity/v3/system/users/5d427682991144899fae27d915cd01cd/roles/028945f544094c26933c8ef60a480e9a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:25:58.516701 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33bd58f-4289-43ed-805e-399bb3d1f4b2 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:58.535547 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:58.540692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbadf3-5ed9-423e-b473-1aa3f60f0346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:58.541315 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbadf3-5ed9-423e-b473-1aa3f60f0346 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:58.541600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbadf3-5ed9-423e-b473-1aa3f60f0346 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:58.541871 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbadf3-5ed9-423e-b473-1aa3f60f0346 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:58.542732 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdbadf3-5ed9-423e-b473-1aa3f60f0346 None admin] RBAC: Adding query filter params (role.id=c1ddd6c095d041d4a18c8cf126582891, user.id=ce4cca48251f47c396fc68f1eacea52d, scope.system=all) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:58.543201 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdbadf3-5ed9-423e-b473-1aa3f60f0346 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:58.544845 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdbadf3-5ed9-423e-b473-1aa3f60f0346 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:58.557234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 152/312] 10.222.0.62 () {56 vars in 1308 bytes} [Mon Aug 22 20:25:58 2022] GET /identity/v3/role_assignments?user.id=ce4cca48251f47c396fc68f1eacea52d&scope.system=all&role.id=c1ddd6c095d041d4a18c8cf126582891 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:58.590194 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:58.666683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33bd58f-4289-43ed-805e-399bb3d1f4b2 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:58.708290 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994855cb-1e52-47c4-ad9e-a11ddb1570e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:58.709119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994855cb-1e52-47c4-ad9e-a11ddb1570e1 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:58.709398 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994855cb-1e52-47c4-ad9e-a11ddb1570e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:58.709663 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994855cb-1e52-47c4-ad9e-a11ddb1570e1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:58.722158 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994855cb-1e52-47c4-ad9e-a11ddb1570e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:25:58.729060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-994855cb-1e52-47c4-ad9e-a11ddb1570e1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:25:58.729060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:25:58.729060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:25:58.729060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:25:58.729060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:25:58.729060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:25:58.729060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:25:58.729060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:25:58.729060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:25:58.729060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:25:58.729060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:25:58.729060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:25:58.729060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:25:58.729060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:25:58.729060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:25:58.729060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:25:58.729975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:25:58.729975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:25:58.729975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:25:58.729975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:25:58.729975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:25:58.729975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:25:58.729975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:25:58.729975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:25:58.729975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:25:58.729975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:25:58.729975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:25:58.729975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:25:58.729975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:25:58.729975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:25:58.729975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:25:58.729975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:25:58.730739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:25:58.730739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:25:58.730739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:25:58.730739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:25:58.730739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:25:58.730739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:25:58.730739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:25:58.730739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:25:58.730739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:25:58.730739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:25:58.730739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:25:58.730739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:25:58.730739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 161/313] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:25:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:25:58.737957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbadf3-5ed9-423e-b473-1aa3f60f0346 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:58.844637 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbadf3-5ed9-423e-b473-1aa3f60f0346 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:58.879719 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6ea3f-c825-453c-b9d9-6a76762f3f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:58.880328 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6ea3f-c825-453c-b9d9-6a76762f3f3f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:58.880606 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6ea3f-c825-453c-b9d9-6a76762f3f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:58.880903 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6ea3f-c825-453c-b9d9-6a76762f3f3f None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:58.881564 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6ea3f-c825-453c-b9d9-6a76762f3f3f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:58.881885 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6ea3f-c825-453c-b9d9-6a76762f3f3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:58.883827 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6ea3f-c825-453c-b9d9-6a76762f3f3f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:58.892540 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 153/314] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 22 20:25:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:58.898090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994855cb-1e52-47c4-ad9e-a11ddb1570e1 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:59.008160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994855cb-1e52-47c4-ad9e-a11ddb1570e1 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:59.023549 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:59.044349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157d4e8-f793-4001-a6df-ec3df943c48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:59.045277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157d4e8-f793-4001-a6df-ec3df943c48d None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:59.045750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157d4e8-f793-4001-a6df-ec3df943c48d None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:59.046237 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157d4e8-f793-4001-a6df-ec3df943c48d None admin] PATH_INFO: `/v3/users/f43b9bfda4084fe39670022a6945abff` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:59.047548 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157d4e8-f793-4001-a6df-ec3df943c48d None admin] RBAC: Authorizing `identity:get_user(user_id=f43b9bfda4084fe39670022a6945abff)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:59.049204 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157d4e8-f793-4001-a6df-ec3df943c48d None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:59.051242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 162/315] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:25:58 2022] GET /identity/v3/users/f43b9bfda4084fe39670022a6945abff => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:59.057184 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6ea3f-c825-453c-b9d9-6a76762f3f3f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:59.108204 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:59.166021 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6ea3f-c825-453c-b9d9-6a76762f3f3f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:59.201821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20516a8c-41d6-4760-a70c-3caa258ddfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:59.202427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20516a8c-41d6-4760-a70c-3caa258ddfc4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:59.202706 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20516a8c-41d6-4760-a70c-3caa258ddfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:59.202975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20516a8c-41d6-4760-a70c-3caa258ddfc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:59.278850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20516a8c-41d6-4760-a70c-3caa258ddfc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:59.280320 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20516a8c-41d6-4760-a70c-3caa258ddfc4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:59.338621 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:25:59.395466 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 154/316] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:25:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:25:59.401645 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157d4e8-f793-4001-a6df-ec3df943c48d None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:59.512646 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157d4e8-f793-4001-a6df-ec3df943c48d None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:59.548235 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e8a6dd-b67f-41b2-9b66-a10580bbf63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:59.548901 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8a6dd-b67f-41b2-9b66-a10580bbf63f None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:59.549178 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8a6dd-b67f-41b2-9b66-a10580bbf63f None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:59.549447 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8a6dd-b67f-41b2-9b66-a10580bbf63f None admin] PATH_INFO: `/v3/projects/d0af86473fde40a2b26933e4ecd0901a` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:59.550570 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e8a6dd-b67f-41b2-9b66-a10580bbf63f None admin] RBAC: Authorizing `identity:get_project(project_id=d0af86473fde40a2b26933e4ecd0901a)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:59.551998 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e8a6dd-b67f-41b2-9b66-a10580bbf63f None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:59.553988 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 163/317] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:25:59 2022] GET /identity/v3/projects/d0af86473fde40a2b26933e4ecd0901a => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:25:59.562020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20516a8c-41d6-4760-a70c-3caa258ddfc4 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:25:59.672771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20516a8c-41d6-4760-a70c-3caa258ddfc4 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:25:59.709854 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098bc34-7b70-4ac5-aeda-e858ae3e0f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:25:59.711404 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098bc34-7b70-4ac5-aeda-e858ae3e0f9b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:25:59.711985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098bc34-7b70-4ac5-aeda-e858ae3e0f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:25:59.712522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098bc34-7b70-4ac5-aeda-e858ae3e0f9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:25:59.713497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098bc34-7b70-4ac5-aeda-e858ae3e0f9b None admin] RBAC: Adding query filter params (role.id=c1ddd6c095d041d4a18c8cf126582891, scope.project.id=d0af86473fde40a2b26933e4ecd0901a, user.id=f43b9bfda4084fe39670022a6945abff) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:25:59.714003 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098bc34-7b70-4ac5-aeda-e858ae3e0f9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:25:59.715782 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098bc34-7b70-4ac5-aeda-e858ae3e0f9b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:25:59.723080 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 155/318] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:25:59 2022] GET /identity/v3/role_assignments?user.id=f43b9bfda4084fe39670022a6945abff&scope.project.id=d0af86473fde40a2b26933e4ecd0901a&role.id=c1ddd6c095d041d4a18c8cf126582891 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:00.188131 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee8b99-b170-4849-9623-30e610df9b65 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:00.188446 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee8b99-b170-4849-9623-30e610df9b65 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:00.188815 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee8b99-b170-4849-9623-30e610df9b65 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:00.190317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 164/319] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:00.195895 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740beb50-fb01-4e00-8a19-6dbd6cf668d2 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:00.196344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740beb50-fb01-4e00-8a19-6dbd6cf668d2 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:00.196418 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740beb50-fb01-4e00-8a19-6dbd6cf668d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:00.214998 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-740beb50-fb01-4e00-8a19-6dbd6cf668d2 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:00.216173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-740beb50-fb01-4e00-8a19-6dbd6cf668d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:00.219837 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:00.285417 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 156/320] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:00.498162 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a36958-5aeb-420d-bd12-78dd0192be99 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:00.498664 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a36958-5aeb-420d-bd12-78dd0192be99 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:00.498664 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a36958-5aeb-420d-bd12-78dd0192be99 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:00.500116 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 165/321] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:00.505010 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40571a82-e773-409e-b538-3118bc86e0a7 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:00.505296 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40571a82-e773-409e-b538-3118bc86e0a7 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:00.505596 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40571a82-e773-409e-b538-3118bc86e0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:00.523531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-40571a82-e773-409e-b538-3118bc86e0a7 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:00.524737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-40571a82-e773-409e-b538-3118bc86e0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:00.537713 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1146561-8c95-4848-b553-f87b011244d7 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:00.538530 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1146561-8c95-4848-b553-f87b011244d7 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:00.538812 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1146561-8c95-4848-b553-f87b011244d7 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:00.540250 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 166/322] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:00.545021 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040931b-cead-449f-9d37-8b7a28d3e8ab None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:00.545301 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040931b-cead-449f-9d37-8b7a28d3e8ab None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:00.545574 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040931b-cead-449f-9d37-8b7a28d3e8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:00.563847 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-3040931b-cead-449f-9d37-8b7a28d3e8ab None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:00.565090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-3040931b-cead-449f-9d37-8b7a28d3e8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:00.595328 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 157/323] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:00.596164 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40571a82-e773-409e-b538-3118bc86e0a7 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:00.613956 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:00.634755 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 167/324] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:26:00.671274 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:00.700781 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40571a82-e773-409e-b538-3118bc86e0a7 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:00.734714 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a163af-2d4b-4231-a632-28f546d0fd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:00.735331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a163af-2d4b-4231-a632-28f546d0fd33 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:00.735605 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a163af-2d4b-4231-a632-28f546d0fd33 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:00.735875 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a163af-2d4b-4231-a632-28f546d0fd33 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:00.736978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a163af-2d4b-4231-a632-28f546d0fd33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:00.738406 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a163af-2d4b-4231-a632-28f546d0fd33 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:00.740126 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 158/325] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:00.746010 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040931b-cead-449f-9d37-8b7a28d3e8ab None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:00.852235 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040931b-cead-449f-9d37-8b7a28d3e8ab None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:00.863761 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a163af-2d4b-4231-a632-28f546d0fd33 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:00.886349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260ede3-63e9-4d02-bd33-a58cb5b754e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:00.886955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260ede3-63e9-4d02-bd33-a58cb5b754e0 None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:00.887229 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260ede3-63e9-4d02-bd33-a58cb5b754e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:00.887492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260ede3-63e9-4d02-bd33-a58cb5b754e0 None admin] PATH_INFO: `/v3/groups` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:00.888108 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1260ede3-63e9-4d02-bd33-a58cb5b754e0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:00.889582 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1260ede3-63e9-4d02-bd33-a58cb5b754e0 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:00.968594 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a163af-2d4b-4231-a632-28f546d0fd33 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:00.993766 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 168/326] 10.222.0.62 () {60 vars in 1134 bytes} [Mon Aug 22 20:26:00 2022] POST /identity/v3/groups => generated 226 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:26:00.994675 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260ede3-63e9-4d02-bd33-a58cb5b754e0 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:01.005498 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9933f9-3432-406e-81fe-f3ad8dc91620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:01.006160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9933f9-3432-406e-81fe-f3ad8dc91620 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:01.006442 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9933f9-3432-406e-81fe-f3ad8dc91620 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:01.006738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9933f9-3432-406e-81fe-f3ad8dc91620 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:01.015203 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:01.019710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9933f9-3432-406e-81fe-f3ad8dc91620 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:01.025459 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-ee9933f9-3432-406e-81fe-f3ad8dc91620 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:26:01.025459 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:01.025459 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:01.025459 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:01.025459 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:01.025459 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:01.025459 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:01.025459 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:01.025459 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:01.025459 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:01.025459 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:01.025459 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:01.025459 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:01.025459 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:01.025459 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:01.025459 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:01.026412 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:01.026412 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:01.026412 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:01.026412 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:01.026412 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:01.026412 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:01.026412 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:01.026412 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:01.026412 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:01.026412 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:01.026412 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:01.026412 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:01.026412 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:01.026412 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:01.026412 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:01.026412 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:01.027214 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:01.027214 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:01.027214 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:01.027214 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:01.027214 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:01.027214 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:01.027214 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:01.027214 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:01.027214 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:01.027214 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:01.027214 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:26:01.027214 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:01.027214 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 159/327] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:26:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:26:01.033203 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9933f9-3432-406e-81fe-f3ad8dc91620 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:01.055531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:01.124310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260ede3-63e9-4d02-bd33-a58cb5b754e0 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:01.151677 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9933f9-3432-406e-81fe-f3ad8dc91620 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:01.161765 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2e6e1-2e50-4a99-89c7-d9c095df2ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:01.162402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2e6e1-2e50-4a99-89c7-d9c095df2ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:01.162683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2e6e1-2e50-4a99-89c7-d9c095df2ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:01.163790 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2e6e1-2e50-4a99-89c7-d9c095df2ea0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:01.176043 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc2e6e1-2e50-4a99-89c7-d9c095df2ea0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:01.182182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-cfc2e6e1-2e50-4a99-89c7-d9c095df2ea0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:26:01.182182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:01.182182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:01.182182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:01.182182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:01.182182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:01.182182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:01.182182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:01.182182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:01.182182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:01.182182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:01.182182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:01.182182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:01.182182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:01.182182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:01.182182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:01.183230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:01.183230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:01.183230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:01.183230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:01.183230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:01.183230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:01.183230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:01.183230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:01.183230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:01.183230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:01.183230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:01.183230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:01.183230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:01.183230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:01.183230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:01.183230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:01.184023 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:01.184023 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:01.184023 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:01.184023 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:01.184023 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:01.184023 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:01.184023 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:01.184023 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:01.184023 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:01.184023 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:01.184023 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:26:01.184023 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:01.184023 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 169/328] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:26:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:01.189783 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2e6e1-2e50-4a99-89c7-d9c095df2ea0 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:01.192637 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce973ac-5745-4087-8455-cf97a80a6785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:01.194054 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce973ac-5745-4087-8455-cf97a80a6785 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:01.194054 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce973ac-5745-4087-8455-cf97a80a6785 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:01.194054 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce973ac-5745-4087-8455-cf97a80a6785 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:01.194617 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce973ac-5745-4087-8455-cf97a80a6785 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:01.194990 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce973ac-5745-4087-8455-cf97a80a6785 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:01.196459 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce973ac-5745-4087-8455-cf97a80a6785 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:01.207571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 160/329] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 22 20:26:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:26:01.213571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce973ac-5745-4087-8455-cf97a80a6785 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:01.294785 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:01.332635 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:01.340754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2e6e1-2e50-4a99-89c7-d9c095df2ea0 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:01.352297 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce973ac-5745-4087-8455-cf97a80a6785 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:01.393530 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294225a-2a40-42eb-ade7-e2d799c73d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:01.394154 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294225a-2a40-42eb-ade7-e2d799c73d31 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:01.394434 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294225a-2a40-42eb-ade7-e2d799c73d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:01.394705 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294225a-2a40-42eb-ade7-e2d799c73d31 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:01.395510 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294225a-2a40-42eb-ade7-e2d799c73d31 None admin] RBAC: Adding query filter params (name=member) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:01.395811 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294225a-2a40-42eb-ade7-e2d799c73d31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:01.398539 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294225a-2a40-42eb-ade7-e2d799c73d31 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:01.401311 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df8ab9-13f4-4bdc-910c-d752b2388945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:01.402188 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df8ab9-13f4-4bdc-910c-d752b2388945 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:01.402671 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df8ab9-13f4-4bdc-910c-d752b2388945 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:01.403148 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df8ab9-13f4-4bdc-910c-d752b2388945 None admin] PATH_INFO: `/v3/users/ce4cca48251f47c396fc68f1eacea52d` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:01.404489 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df8ab9-13f4-4bdc-910c-d752b2388945 None admin] RBAC: Authorizing `identity:get_user(user_id=ce4cca48251f47c396fc68f1eacea52d)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:01.406177 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df8ab9-13f4-4bdc-910c-d752b2388945 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:01.412689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 170/330] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 22 20:26:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:26:01.413555 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 161/331] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:26:01 2022] GET /identity/v3/users/ce4cca48251f47c396fc68f1eacea52d => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:26:01.414755 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294225a-2a40-42eb-ade7-e2d799c73d31 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:01.416641 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df8ab9-13f4-4bdc-910c-d752b2388945 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:01.551085 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294225a-2a40-42eb-ade7-e2d799c73d31 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:01.551601 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df8ab9-13f4-4bdc-910c-d752b2388945 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:01.592445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:01.596534 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50162f53-9995-4f52-a460-098111707adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:01.598438 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50162f53-9995-4f52-a460-098111707adf None admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:01.598734 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50162f53-9995-4f52-a460-098111707adf None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:01.604486 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50162f53-9995-4f52-a460-098111707adf None admin] PATH_INFO: `/v3/system/users/ce4cca48251f47c396fc68f1eacea52d/roles/c1ddd6c095d041d4a18c8cf126582891` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:01.604606 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e87ba-5d7a-48d3-b3c3-db198379d42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:01.604606 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e87ba-5d7a-48d3-b3c3-db198379d42b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:01.604606 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e87ba-5d7a-48d3-b3c3-db198379d42b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:01.604850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50162f53-9995-4f52-a460-098111707adf None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ce4cca48251f47c396fc68f1eacea52d, role_id=c1ddd6c095d041d4a18c8cf126582891)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:01.604922 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e87ba-5d7a-48d3-b3c3-db198379d42b None admin] PATH_INFO: `/v3/users/5d427682991144899fae27d915cd01cd` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:01.604988 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50162f53-9995-4f52-a460-098111707adf None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:01.605054 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e87ba-5d7a-48d3-b3c3-db198379d42b None admin] RBAC: Authorizing `identity:get_user(user_id=5d427682991144899fae27d915cd01cd)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:01.605118 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e87ba-5d7a-48d3-b3c3-db198379d42b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:01.607317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 162/332] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:26:01 2022] GET /identity/v3/users/5d427682991144899fae27d915cd01cd => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:01.613239 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e87ba-5d7a-48d3-b3c3-db198379d42b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:01.697690 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 171/333] 10.222.0.62 () {58 vars in 1334 bytes} [Mon Aug 22 20:26:01 2022] PUT /identity/v3/system/users/ce4cca48251f47c396fc68f1eacea52d/roles/c1ddd6c095d041d4a18c8cf126582891 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:26:01.724075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e87ba-5d7a-48d3-b3c3-db198379d42b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:01.764033 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e9992-b8b6-41a0-bdab-71da7e9ce885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:01.764676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e9992-b8b6-41a0-bdab-71da7e9ce885 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:01.764967 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e9992-b8b6-41a0-bdab-71da7e9ce885 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:01.765241 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e9992-b8b6-41a0-bdab-71da7e9ce885 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:01.765985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e9992-b8b6-41a0-bdab-71da7e9ce885 None admin] RBAC: Adding query filter params (role.id=028945f544094c26933c8ef60a480e9a, user.id=5d427682991144899fae27d915cd01cd, scope.system=all) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:01.766303 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e9992-b8b6-41a0-bdab-71da7e9ce885 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:01.767874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e9992-b8b6-41a0-bdab-71da7e9ce885 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:01.782510 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 163/334] 10.222.0.62 () {56 vars in 1308 bytes} [Mon Aug 22 20:26:01 2022] GET /identity/v3/role_assignments?user.id=5d427682991144899fae27d915cd01cd&scope.system=all&role.id=028945f544094c26933c8ef60a480e9a => generated 510 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:26:03.285777 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b16254-ad20-44e4-abca-aef9a47810e1 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:03.286319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b16254-ad20-44e4-abca-aef9a47810e1 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:03.286319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b16254-ad20-44e4-abca-aef9a47810e1 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:03.288394 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 172/335] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:03.295050 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ef9a9-927f-4083-965e-11fb468e8550 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:03.295499 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ef9a9-927f-4083-965e-11fb468e8550 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:03.295678 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ef9a9-927f-4083-965e-11fb468e8550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:03.318470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-2d7ef9a9-927f-4083-965e-11fb468e8550 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:03.320301 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2d7ef9a9-927f-4083-965e-11fb468e8550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:03.396419 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:03.418504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 164/336] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:26:03.693710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ffedd-c3aa-47a5-8f1e-54675a27d541 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:03.695026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ffedd-c3aa-47a5-8f1e-54675a27d541 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:03.695501 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ffedd-c3aa-47a5-8f1e-54675a27d541 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:03.697043 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 173/337] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:03.703083 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33669f15-3868-4f64-ba2f-bcbf365ee865 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:03.703367 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33669f15-3868-4f64-ba2f-bcbf365ee865 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:03.703640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33669f15-3868-4f64-ba2f-bcbf365ee865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:03.729691 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-33669f15-3868-4f64-ba2f-bcbf365ee865 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:03.730931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-33669f15-3868-4f64-ba2f-bcbf365ee865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:03.828798 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 165/338] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:03.842936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ffedd-c3aa-47a5-8f1e-54675a27d541 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:03.887020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:03.985730 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ffedd-c3aa-47a5-8f1e-54675a27d541 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:04.029046 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188f411-c2e0-4cd4-bb91-515352deaea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:04.029684 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188f411-c2e0-4cd4-bb91-515352deaea8 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:04.029998 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188f411-c2e0-4cd4-bb91-515352deaea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:04.030224 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188f411-c2e0-4cd4-bb91-515352deaea8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:04.047017 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c188f411-c2e0-4cd4-bb91-515352deaea8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:04.051801 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-c188f411-c2e0-4cd4-bb91-515352deaea8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:26:04.051801 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:04.051801 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:04.051801 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:04.051801 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:04.051801 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:04.051801 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:04.051801 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:04.051801 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:04.051801 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:04.051801 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:04.051801 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:04.051801 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:04.051801 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:04.051801 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:04.051801 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:04.052692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:04.052692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:04.052692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:04.052692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:04.052692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:04.052692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:04.052692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:04.052692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:04.052692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:04.052692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:04.052692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:04.052692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:04.052692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:04.052692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:04.052692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:04.052692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:04.053548 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:04.053548 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:04.053548 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:04.053548 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:04.053548 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:04.053548 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:04.053548 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:04.053548 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:04.053548 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:04.053548 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:04.053548 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:26:04.053548 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:04.053548 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 174/339] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:26:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:04.058923 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33669f15-3868-4f64-ba2f-bcbf365ee865 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:04.109299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8044a16-9bc8-4bc0-bc85-b271193384ca None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:04.109868 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8044a16-9bc8-4bc0-bc85-b271193384ca None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:04.110146 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8044a16-9bc8-4bc0-bc85-b271193384ca None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:04.111983 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 175/340] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:04.117566 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea640b-92b3-4d42-9a21-50f42c783e6d None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:04.117848 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea640b-92b3-4d42-9a21-50f42c783e6d None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:04.118124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea640b-92b3-4d42-9a21-50f42c783e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:04.145518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-5aea640b-92b3-4d42-9a21-50f42c783e6d None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:04.146903 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-5aea640b-92b3-4d42-9a21-50f42c783e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:04.242880 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33669f15-3868-4f64-ba2f-bcbf365ee865 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:04.270203 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 176/341] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:04.271084 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea640b-92b3-4d42-9a21-50f42c783e6d None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:04.271961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:04.305432 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:04.312988 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95361d90-3f70-44b9-8ede-647ae38b37b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:04.313605 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95361d90-3f70-44b9-8ede-647ae38b37b5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:04.313883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95361d90-3f70-44b9-8ede-647ae38b37b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:04.314151 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95361d90-3f70-44b9-8ede-647ae38b37b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:04.314884 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95361d90-3f70-44b9-8ede-647ae38b37b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:04.315191 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95361d90-3f70-44b9-8ede-647ae38b37b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:04.316639 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95361d90-3f70-44b9-8ede-647ae38b37b5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:04.336250 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 166/342] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 22 20:26:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:04.337474 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95361d90-3f70-44b9-8ede-647ae38b37b5 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:04.490607 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea640b-92b3-4d42-9a21-50f42c783e6d None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:04.526649 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95361d90-3f70-44b9-8ede-647ae38b37b5 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:04.562973 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199033d-dac7-44c7-aa08-ab22d273e39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:04.563613 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199033d-dac7-44c7-aa08-ab22d273e39e None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:04.563884 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199033d-dac7-44c7-aa08-ab22d273e39e None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:04.564151 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199033d-dac7-44c7-aa08-ab22d273e39e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:04.578582 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199033d-dac7-44c7-aa08-ab22d273e39e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:04.583538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-7199033d-dac7-44c7-aa08-ab22d273e39e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:26:04.583538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:04.583538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:04.583538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:04.583538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:04.583538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:04.583538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:04.583538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:04.583538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:04.583538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:04.583538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:04.583538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:04.583538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:04.583538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:04.583538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:04.583538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:04.584401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:04.584401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:04.584401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:04.584401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:04.584401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:04.584401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:04.584401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:04.584401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:04.584401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:04.584401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:04.584401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:04.584401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:04.584401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:04.584401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:04.584401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:04.584401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:04.586753 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:04.586753 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:04.586753 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:04.586753 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:04.586753 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:04.586753 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:04.586753 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:04.586753 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:04.586753 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:04.586753 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:04.586753 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:26:04.586753 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:04.588053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 177/343] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 22 20:26:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:04.589354 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835369da-20a6-4439-83d0-7b01f3f5845b None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:04.589637 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835369da-20a6-4439-83d0-7b01f3f5845b None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:04.589927 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835369da-20a6-4439-83d0-7b01f3f5845b None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:04.591349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 178/344] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:04.591864 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835369da-20a6-4439-83d0-7b01f3f5845b None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:04.613958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59bb7c-3039-4dfd-8905-1bbfe3750a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:04.614589 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59bb7c-3039-4dfd-8905-1bbfe3750a53 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:04.614875 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59bb7c-3039-4dfd-8905-1bbfe3750a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:04.615149 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59bb7c-3039-4dfd-8905-1bbfe3750a53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:04.679356 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:04.705151 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835369da-20a6-4439-83d0-7b01f3f5845b None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:04.727980 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:04.745782 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d5d42-2a9e-4ae7-8efa-32163dae5cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:04.746395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d5d42-2a9e-4ae7-8efa-32163dae5cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:04.746669 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d5d42-2a9e-4ae7-8efa-32163dae5cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:04.746935 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d5d42-2a9e-4ae7-8efa-32163dae5cd0 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:04.747596 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d5d42-2a9e-4ae7-8efa-32163dae5cd0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:04.748050 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d5d42-2a9e-4ae7-8efa-32163dae5cd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:04.749466 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d5d42-2a9e-4ae7-8efa-32163dae5cd0 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:04.758171 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 179/345] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:26:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:04.759439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7424ba-9ef4-4885-80c7-3ca63a72c781 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:04.760837 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7424ba-9ef4-4885-80c7-3ca63a72c781 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:04.760837 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7424ba-9ef4-4885-80c7-3ca63a72c781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:04.768514 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e59bb7c-3039-4dfd-8905-1bbfe3750a53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:04.770012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e59bb7c-3039-4dfd-8905-1bbfe3750a53 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:04.789291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-ab7424ba-9ef4-4885-80c7-3ca63a72c781 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:04.791467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-ab7424ba-9ef4-4885-80c7-3ca63a72c781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:04.878389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 180/346] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:04.879027 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7424ba-9ef4-4885-80c7-3ca63a72c781 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:04.892233 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 167/347] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:26:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:26:04.893133 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59bb7c-3039-4dfd-8905-1bbfe3750a53 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:04.952965 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:04.989223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:05.004761 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7424ba-9ef4-4885-80c7-3ca63a72c781 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:05.023685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59bb7c-3039-4dfd-8905-1bbfe3750a53 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:05.043705 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb04288-21c6-4382-accb-c1024738303e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:05.044263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb04288-21c6-4382-accb-c1024738303e None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:05.044539 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb04288-21c6-4382-accb-c1024738303e None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:05.044831 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb04288-21c6-4382-accb-c1024738303e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:05.062304 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb04288-21c6-4382-accb-c1024738303e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:05.067433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-5fb04288-21c6-4382-accb-c1024738303e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:26:05.067433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:05.067433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:05.067433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:05.067433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:05.067433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:05.067433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:05.067433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:05.067433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:05.067433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:05.067433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:05.067433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:05.067433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:05.067433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:05.067433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:05.067433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:05.068525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:05.068525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:05.068525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:05.068525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:05.068525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:05.068525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:05.068525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:05.068525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:05.068525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:05.068525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:05.068525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:05.068525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:05.068525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:05.068525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:05.068525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:05.068525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:05.069942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:05.069942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:05.069942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:05.069942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:05.069942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:05.069942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:05.069942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:05.069942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:05.069942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:05.069942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:05.069942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:26:05.069942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:05.069942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 181/348] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:26:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:05.070724 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb04288-21c6-4382-accb-c1024738303e None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:05.113377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc216b7c-7c45-4a4d-abee-843849f5d46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:05.114158 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc216b7c-7c45-4a4d-abee-843849f5d46d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:05.114533 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc216b7c-7c45-4a4d-abee-843849f5d46d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:05.114903 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc216b7c-7c45-4a4d-abee-843849f5d46d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:05.179430 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb04288-21c6-4382-accb-c1024738303e None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:05.215712 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfadba-4d91-4142-891b-29beeb90f566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:05.216343 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfadba-4d91-4142-891b-29beeb90f566 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:05.216617 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfadba-4d91-4142-891b-29beeb90f566 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:05.216939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfadba-4d91-4142-891b-29beeb90f566 None admin] PATH_INFO: `/v3/projects/3883b1b257924533a84cbc24a92ea6e1` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:05.218030 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfadba-4d91-4142-891b-29beeb90f566 None admin] RBAC: Authorizing `identity:get_project(project_id=3883b1b257924533a84cbc24a92ea6e1)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:05.219555 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfadba-4d91-4142-891b-29beeb90f566 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:05.222377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 182/349] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:26:05 2022] GET /identity/v3/projects/3883b1b257924533a84cbc24a92ea6e1 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:05.223137 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfadba-4d91-4142-891b-29beeb90f566 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:05.233047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:05.310884 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc216b7c-7c45-4a4d-abee-843849f5d46d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:05.312276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc216b7c-7c45-4a4d-abee-843849f5d46d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:05.333932 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfadba-4d91-4142-891b-29beeb90f566 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:05.372701 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605a16d-6e9f-4e51-8266-c46142cf60d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:05.373304 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605a16d-6e9f-4e51-8266-c46142cf60d6 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:05.373644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605a16d-6e9f-4e51-8266-c46142cf60d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:05.373915 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605a16d-6e9f-4e51-8266-c46142cf60d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:05.374576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605a16d-6e9f-4e51-8266-c46142cf60d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:05.374924 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605a16d-6e9f-4e51-8266-c46142cf60d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:05.376297 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605a16d-6e9f-4e51-8266-c46142cf60d6 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:05.387844 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 183/350] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 22 20:26:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:05.394515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605a16d-6e9f-4e51-8266-c46142cf60d6 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:05.428178 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:05.459237 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 168/351] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:26:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:26:05.460140 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc216b7c-7c45-4a4d-abee-843849f5d46d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:05.469553 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:05.529101 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605a16d-6e9f-4e51-8266-c46142cf60d6 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:05.577639 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15c99b-3938-41db-bdb5-42873c657383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:05.578181 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15c99b-3938-41db-bdb5-42873c657383 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:05.578461 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15c99b-3938-41db-bdb5-42873c657383 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:05.578726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15c99b-3938-41db-bdb5-42873c657383 None admin] PATH_INFO: `/v3/groups/519cc8d7a5624287873ae043faef85ad` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:05.586537 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15c99b-3938-41db-bdb5-42873c657383 None admin] RBAC: Authorizing `identity:get_group(group_id=519cc8d7a5624287873ae043faef85ad)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:05.588003 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15c99b-3938-41db-bdb5-42873c657383 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:05.589736 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 184/352] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Aug 22 20:26:05 2022] GET /identity/v3/groups/519cc8d7a5624287873ae043faef85ad => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:05.590332 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc216b7c-7c45-4a4d-abee-843849f5d46d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:05.590892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17627139-5f71-4568-8ff4-eecae0ffa778 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:05.591172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17627139-5f71-4568-8ff4-eecae0ffa778 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:05.591439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17627139-5f71-4568-8ff4-eecae0ffa778 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:05.592792 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 185/353] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:05.593402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17627139-5f71-4568-8ff4-eecae0ffa778 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:05.629042 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943809ab-b3ea-43e3-922b-881789b6f2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:05.629675 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943809ab-b3ea-43e3-922b-881789b6f2f8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:05.629946 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943809ab-b3ea-43e3-922b-881789b6f2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:05.630212 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943809ab-b3ea-43e3-922b-881789b6f2f8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:05.642429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943809ab-b3ea-43e3-922b-881789b6f2f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:05.647681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-943809ab-b3ea-43e3-922b-881789b6f2f8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:26:05.647681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:05.647681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:05.647681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:05.647681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:05.647681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:05.647681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:05.647681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:05.647681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:05.647681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:05.647681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:05.647681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:05.647681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:05.647681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:05.647681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:05.647681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:05.648561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:05.648561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:05.648561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:05.648561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:05.648561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:05.648561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:05.648561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:05.648561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:05.648561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:05.648561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:05.648561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:05.648561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:05.648561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:05.648561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:05.648561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:05.648561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:05.649435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:05.649435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:05.649435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:05.649435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:05.649435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:05.649435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:05.649435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:05.649435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:05.649435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:05.649435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:05.649435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 20:26:05.649435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:05.655349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 169/354] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:26:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:05.656230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943809ab-b3ea-43e3-922b-881789b6f2f8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:05.696733 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:05.724836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17627139-5f71-4568-8ff4-eecae0ffa778 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:05.756037 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:05.770788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800877b-715a-4ba4-88d7-3c53af61945d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:05.771397 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800877b-715a-4ba4-88d7-3c53af61945d None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:05.771674 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800877b-715a-4ba4-88d7-3c53af61945d None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:05.772597 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800877b-715a-4ba4-88d7-3c53af61945d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:05.787156 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943809ab-b3ea-43e3-922b-881789b6f2f8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:05.843405 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9380161-beaa-45a2-9246-1de8a823e6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:05.844092 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9380161-beaa-45a2-9246-1de8a823e6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:05.844432 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9380161-beaa-45a2-9246-1de8a823e6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:05.844748 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9380161-beaa-45a2-9246-1de8a823e6f1 None admin] PATH_INFO: `/v3/projects/3883b1b257924533a84cbc24a92ea6e1` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:05.846094 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9380161-beaa-45a2-9246-1de8a823e6f1 None admin] RBAC: Authorizing `identity:get_project(project_id=3883b1b257924533a84cbc24a92ea6e1)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:05.847338 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9380161-beaa-45a2-9246-1de8a823e6f1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:05.850077 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 170/355] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:26:05 2022] GET /identity/v3/projects/3883b1b257924533a84cbc24a92ea6e1 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:05.851342 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9380161-beaa-45a2-9246-1de8a823e6f1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:05.867824 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800877b-715a-4ba4-88d7-3c53af61945d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:05.869931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800877b-715a-4ba4-88d7-3c53af61945d None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:05.975587 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9380161-beaa-45a2-9246-1de8a823e6f1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:05.978125 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:05.994312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 186/356] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:26:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:26:05.995848 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98c886-db3c-4c56-9d18-2f22784c8ae6 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:05.996188 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98c886-db3c-4c56-9d18-2f22784c8ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:05.996396 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98c886-db3c-4c56-9d18-2f22784c8ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:06.016133 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-ec98c886-db3c-4c56-9d18-2f22784c8ae6 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:06.017392 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-ec98c886-db3c-4c56-9d18-2f22784c8ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:06.019891 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992420f7-bac7-4833-b3a6-9acf4bb41d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:06.020500 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992420f7-bac7-4833-b3a6-9acf4bb41d9b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:06.021880 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992420f7-bac7-4833-b3a6-9acf4bb41d9b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:06.021880 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992420f7-bac7-4833-b3a6-9acf4bb41d9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:06.021880 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992420f7-bac7-4833-b3a6-9acf4bb41d9b None admin] RBAC: Adding query filter params (group.id=519cc8d7a5624287873ae043faef85ad, role.id=028945f544094c26933c8ef60a480e9a, scope.project.id=3883b1b257924533a84cbc24a92ea6e1) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:06.022739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992420f7-bac7-4833-b3a6-9acf4bb41d9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:06.024595 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992420f7-bac7-4833-b3a6-9acf4bb41d9b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:06.033355 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 171/357] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Aug 22 20:26:05 2022] GET /identity/v3/role_assignments?group.id=519cc8d7a5624287873ae043faef85ad&scope.project.id=3883b1b257924533a84cbc24a92ea6e1&role.id=028945f544094c26933c8ef60a480e9a => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:06.033355 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992420f7-bac7-4833-b3a6-9acf4bb41d9b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:06.040310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:06.126450 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 187/358] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:06.127210 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98c886-db3c-4c56-9d18-2f22784c8ae6 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:06.177345 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992420f7-bac7-4833-b3a6-9acf4bb41d9b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:06.229296 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23b4fd-8b51-4767-9e78-d380ad27ff44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:06.230276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23b4fd-8b51-4767-9e78-d380ad27ff44 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:06.230618 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23b4fd-8b51-4767-9e78-d380ad27ff44 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:06.230956 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23b4fd-8b51-4767-9e78-d380ad27ff44 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:06.231683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23b4fd-8b51-4767-9e78-d380ad27ff44 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:06.232048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23b4fd-8b51-4767-9e78-d380ad27ff44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:06.233518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23b4fd-8b51-4767-9e78-d380ad27ff44 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:06.245175 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 172/359] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 22 20:26:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:06.250102 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7513b23-df9b-454a-81c8-2c448583a7d7 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:06.250451 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7513b23-df9b-454a-81c8-2c448583a7d7 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:06.250796 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7513b23-df9b-454a-81c8-2c448583a7d7 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:06.252203 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 173/360] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:06.254155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7513b23-df9b-454a-81c8-2c448583a7d7 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:06.263929 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98c886-db3c-4c56-9d18-2f22784c8ae6 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:06.291195 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:06.320277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895710b-8290-4b91-b6e9-f4db16b1e24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:06.320479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895710b-8290-4b91-b6e9-f4db16b1e24b None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:06.322434 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895710b-8290-4b91-b6e9-f4db16b1e24b None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:06.322434 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895710b-8290-4b91-b6e9-f4db16b1e24b None admin] PATH_INFO: `/v3/groups/519cc8d7a5624287873ae043faef85ad` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:06.322434 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895710b-8290-4b91-b6e9-f4db16b1e24b None admin] RBAC: Authorizing `identity:get_group(group_id=519cc8d7a5624287873ae043faef85ad)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:06.323787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895710b-8290-4b91-b6e9-f4db16b1e24b None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:06.326463 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 188/361] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Aug 22 20:26:06 2022] GET /identity/v3/groups/519cc8d7a5624287873ae043faef85ad => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:06.326665 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1225d-9473-432c-943c-6bc904b18335 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:06.326883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1225d-9473-432c-943c-6bc904b18335 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:06.327151 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1225d-9473-432c-943c-6bc904b18335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:06.366980 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-91f1225d-9473-432c-943c-6bc904b18335 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:06.368788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-91f1225d-9473-432c-943c-6bc904b18335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:06.390963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:06.398809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7513b23-df9b-454a-81c8-2c448583a7d7 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:06.441330 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb40839-13b8-4528-90bc-aa49e8f57489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:06.442824 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb40839-13b8-4528-90bc-aa49e8f57489 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:06.443305 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb40839-13b8-4528-90bc-aa49e8f57489 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:06.443820 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb40839-13b8-4528-90bc-aa49e8f57489 None admin] PATH_INFO: `/v3/projects/d0af86473fde40a2b26933e4ecd0901a` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:06.446384 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb40839-13b8-4528-90bc-aa49e8f57489 None admin] RBAC: Authorizing `identity:get_project(project_id=d0af86473fde40a2b26933e4ecd0901a)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:06.448080 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb40839-13b8-4528-90bc-aa49e8f57489 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:06.449888 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 174/362] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:26:06 2022] GET /identity/v3/projects/d0af86473fde40a2b26933e4ecd0901a => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:06.452689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb40839-13b8-4528-90bc-aa49e8f57489 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:06.466889 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 189/363] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:06.467630 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1225d-9473-432c-943c-6bc904b18335 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:06.580427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:06.585348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb40839-13b8-4528-90bc-aa49e8f57489 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:06.593468 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1225d-9473-432c-943c-6bc904b18335 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:06.633033 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529a639-f269-40ae-a766-4e301ca8e62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:06.633638 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529a639-f269-40ae-a766-4e301ca8e62b None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:06.633912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529a639-f269-40ae-a766-4e301ca8e62b None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:06.634218 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529a639-f269-40ae-a766-4e301ca8e62b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:06.634897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529a639-f269-40ae-a766-4e301ca8e62b None admin] RBAC: Adding query filter params (group.id=519cc8d7a5624287873ae043faef85ad, role.id=7f4b8cdb739c4f808ef31961eb11510e, scope.project.id=3883b1b257924533a84cbc24a92ea6e1) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:06.635203 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529a639-f269-40ae-a766-4e301ca8e62b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:06.635760 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835bb162-4505-4c00-abd1-555d13d978aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:06.636541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bb162-4505-4c00-abd1-555d13d978aa None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:06.636685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529a639-f269-40ae-a766-4e301ca8e62b None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:06.637084 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bb162-4505-4c00-abd1-555d13d978aa None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:06.637489 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bb162-4505-4c00-abd1-555d13d978aa None admin] PATH_INFO: `/v3/users/ce4cca48251f47c396fc68f1eacea52d` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:06.640692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835bb162-4505-4c00-abd1-555d13d978aa None admin] RBAC: Authorizing `identity:get_user(user_id=ce4cca48251f47c396fc68f1eacea52d)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:06.642387 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835bb162-4505-4c00-abd1-555d13d978aa None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:06.642692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 190/364] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Aug 22 20:26:06 2022] GET /identity/v3/role_assignments?group.id=519cc8d7a5624287873ae043faef85ad&scope.project.id=3883b1b257924533a84cbc24a92ea6e1&role.id=7f4b8cdb739c4f808ef31961eb11510e => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:06.643496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529a639-f269-40ae-a766-4e301ca8e62b None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:06.649176 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 175/365] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:26:06 2022] GET /identity/v3/users/ce4cca48251f47c396fc68f1eacea52d => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:06.650465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835bb162-4505-4c00-abd1-555d13d978aa None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:06.665378 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:06.797561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529a639-f269-40ae-a766-4e301ca8e62b None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:06.841451 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698e006-49a5-4f84-86fd-3c7eb40ee68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:06.842455 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698e006-49a5-4f84-86fd-3c7eb40ee68b None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:06.842923 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698e006-49a5-4f84-86fd-3c7eb40ee68b None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:06.843389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698e006-49a5-4f84-86fd-3c7eb40ee68b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:06.854142 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835bb162-4505-4c00-abd1-555d13d978aa None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:06.858026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698e006-49a5-4f84-86fd-3c7eb40ee68b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:06.862337 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-2698e006-49a5-4f84-86fd-3c7eb40ee68b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:26:06.862337 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:06.862337 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:06.862337 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:06.862337 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:06.862337 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:06.862337 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:06.862337 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:06.862337 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:06.862337 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:06.862337 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:06.862337 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:06.862337 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:06.862337 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:06.862337 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:06.862337 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:06.863242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:06.863242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:06.863242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:06.863242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:06.863242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:06.863242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:06.863242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:06.863242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:06.863242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:06.863242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:06.863242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:06.863242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:06.863242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:06.863242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:06.863242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:06.863242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:06.864473 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:06.864473 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:06.864473 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:06.864473 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:06.864473 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:06.864473 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:06.864473 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:06.864473 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:06.864473 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:06.864473 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:06.864473 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:26:06.864473 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:06.864473 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 191/366] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 22 20:26:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:06.865403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698e006-49a5-4f84-86fd-3c7eb40ee68b None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:06.902271 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eee4e6-81b3-4312-9c65-9f3965e1d052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:06.903173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eee4e6-81b3-4312-9c65-9f3965e1d052 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:06.903488 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eee4e6-81b3-4312-9c65-9f3965e1d052 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:06.903997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eee4e6-81b3-4312-9c65-9f3965e1d052 None admin] PATH_INFO: `/v3/groups/519cc8d7a5624287873ae043faef85ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:06.905328 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eee4e6-81b3-4312-9c65-9f3965e1d052 None admin] RBAC: Authorizing `identity:get_group(group_id=519cc8d7a5624287873ae043faef85ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:06.907357 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eee4e6-81b3-4312-9c65-9f3965e1d052 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:06.909127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 176/367] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Aug 22 20:26:06 2022] GET /identity/v3/groups/519cc8d7a5624287873ae043faef85ad => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:06.909890 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eee4e6-81b3-4312-9c65-9f3965e1d052 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:06.957888 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:06.973009 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:07.003084 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698e006-49a5-4f84-86fd-3c7eb40ee68b None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:07.041458 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eee4e6-81b3-4312-9c65-9f3965e1d052 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:07.055779 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb76e70-fd9c-4f09-8316-b3be10804894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:07.056688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb76e70-fd9c-4f09-8316-b3be10804894 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:07.056981 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb76e70-fd9c-4f09-8316-b3be10804894 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:07.057252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb76e70-fd9c-4f09-8316-b3be10804894 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:07.058326 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb76e70-fd9c-4f09-8316-b3be10804894 None admin] RBAC: Adding query filter params (role.id=c1ddd6c095d041d4a18c8cf126582891, user.id=ce4cca48251f47c396fc68f1eacea52d, scope.system=all) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:07.059112 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb76e70-fd9c-4f09-8316-b3be10804894 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:07.060879 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb76e70-fd9c-4f09-8316-b3be10804894 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:07.078241 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 192/368] 10.222.0.62 () {56 vars in 1308 bytes} [Mon Aug 22 20:26:06 2022] GET /identity/v3/role_assignments?user.id=ce4cca48251f47c396fc68f1eacea52d&scope.system=all&role.id=c1ddd6c095d041d4a18c8cf126582891 => generated 510 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:07.079299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb76e70-fd9c-4f09-8316-b3be10804894 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:07.080024 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba0243-f09c-4d85-99c7-bdbad77dcdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:07.080531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba0243-f09c-4d85-99c7-bdbad77dcdf5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:07.080834 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba0243-f09c-4d85-99c7-bdbad77dcdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:07.081102 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba0243-f09c-4d85-99c7-bdbad77dcdf5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:07.097560 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba0243-f09c-4d85-99c7-bdbad77dcdf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:07.104825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-08ba0243-f09c-4d85-99c7-bdbad77dcdf5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:26:07.104825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:07.104825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:07.104825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:07.104825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:07.104825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:07.104825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:07.104825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:07.104825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:07.104825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:07.104825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:07.104825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:07.104825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:07.104825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:07.104825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:07.104825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:07.105750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:07.105750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:07.105750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:07.105750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:07.105750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:07.105750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:07.105750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:07.105750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:07.105750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:07.105750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:07.105750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:07.105750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:07.105750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:07.105750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:07.105750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:07.105750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:07.106515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:07.106515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:07.106515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:07.106515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:07.106515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:07.106515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:07.106515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:07.106515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:07.106515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:07.106515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:07.106515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:26:07.106515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:07.111530 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 177/369] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 22 20:26:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:07.112502 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba0243-f09c-4d85-99c7-bdbad77dcdf5 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:07.205832 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb76e70-fd9c-4f09-8316-b3be10804894 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:07.230656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:07.241549 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:07.244133 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba0243-f09c-4d85-99c7-bdbad77dcdf5 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:07.245838 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723628e-82dd-43e1-b645-91589da32074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:07.245838 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723628e-82dd-43e1-b645-91589da32074 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:07.245838 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723628e-82dd-43e1-b645-91589da32074 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:07.246311 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723628e-82dd-43e1-b645-91589da32074 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:07.247286 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723628e-82dd-43e1-b645-91589da32074 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:07.247286 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723628e-82dd-43e1-b645-91589da32074 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:07.248560 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723628e-82dd-43e1-b645-91589da32074 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:07.258464 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 193/370] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:26:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:07.259404 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723628e-82dd-43e1-b645-91589da32074 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:07.296188 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468428d-e08d-4083-9277-e5c53948e592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:07.296848 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468428d-e08d-4083-9277-e5c53948e592 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:07.297122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468428d-e08d-4083-9277-e5c53948e592 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:07.297397 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468428d-e08d-4083-9277-e5c53948e592 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:07.298134 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468428d-e08d-4083-9277-e5c53948e592 None admin] RBAC: Adding query filter params (group.id=519cc8d7a5624287873ae043faef85ad, role.id=028945f544094c26933c8ef60a480e9a, scope.project.id=d0af86473fde40a2b26933e4ecd0901a) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:07.298445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468428d-e08d-4083-9277-e5c53948e592 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:07.299956 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9468428d-e08d-4083-9277-e5c53948e592 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:07.311985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 178/371] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Aug 22 20:26:07 2022] GET /identity/v3/role_assignments?group.id=519cc8d7a5624287873ae043faef85ad&scope.project.id=d0af86473fde40a2b26933e4ecd0901a&role.id=028945f544094c26933c8ef60a480e9a => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:07.313293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468428d-e08d-4083-9277-e5c53948e592 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:07.408413 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723628e-82dd-43e1-b645-91589da32074 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:07.454029 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc9e65-67a5-4e5c-b364-490a58972ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:07.455265 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc9e65-67a5-4e5c-b364-490a58972ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:07.455736 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc9e65-67a5-4e5c-b364-490a58972ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:07.456251 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc9e65-67a5-4e5c-b364-490a58972ec0 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:07.457256 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc9e65-67a5-4e5c-b364-490a58972ec0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:07.458374 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc9e65-67a5-4e5c-b364-490a58972ec0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:07.460033 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc9e65-67a5-4e5c-b364-490a58972ec0 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:07.470894 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 194/372] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:26:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:07.477884 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc9e65-67a5-4e5c-b364-490a58972ec0 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:07.548576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:07.558346 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468428d-e08d-4083-9277-e5c53948e592 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:07.602487 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eae31b-dafb-4fab-a431-31f987223fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:07.603216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eae31b-dafb-4fab-a431-31f987223fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:07.603557 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eae31b-dafb-4fab-a431-31f987223fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:07.603898 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eae31b-dafb-4fab-a431-31f987223fd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:07.609122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc9e65-67a5-4e5c-b364-490a58972ec0 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:07.636666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:07.653643 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995fcd8-53a7-4e75-ab7a-1ab9adfaefc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:07.654552 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995fcd8-53a7-4e75-ab7a-1ab9adfaefc9 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:07.655001 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995fcd8-53a7-4e75-ab7a-1ab9adfaefc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:07.655457 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995fcd8-53a7-4e75-ab7a-1ab9adfaefc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:07.699268 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eae31b-dafb-4fab-a431-31f987223fd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:07.700948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eae31b-dafb-4fab-a431-31f987223fd0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:07.755274 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995fcd8-53a7-4e75-ab7a-1ab9adfaefc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:07.758546 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995fcd8-53a7-4e75-ab7a-1ab9adfaefc9 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:07.833673 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:07.836289 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 179/373] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:26:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:26:07.841994 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eae31b-dafb-4fab-a431-31f987223fd0 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:07.899269 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 195/374] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:26:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:26:07.904630 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995fcd8-53a7-4e75-ab7a-1ab9adfaefc9 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:07.923839 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:07.970574 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eae31b-dafb-4fab-a431-31f987223fd0 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:08.008720 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80774e3-3a7c-40c4-8022-47481a7b3d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:08.009772 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80774e3-3a7c-40c4-8022-47481a7b3d16 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:08.010222 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80774e3-3a7c-40c4-8022-47481a7b3d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:08.010660 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80774e3-3a7c-40c4-8022-47481a7b3d16 None admin] PATH_INFO: `/v3/projects/d0af86473fde40a2b26933e4ecd0901a` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:08.011985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80774e3-3a7c-40c4-8022-47481a7b3d16 None admin] RBAC: Authorizing `identity:get_project(project_id=d0af86473fde40a2b26933e4ecd0901a)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:08.013755 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80774e3-3a7c-40c4-8022-47481a7b3d16 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:08.015711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 180/375] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:26:07 2022] GET /identity/v3/projects/d0af86473fde40a2b26933e4ecd0901a => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:26:08.022516 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80774e3-3a7c-40c4-8022-47481a7b3d16 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:08.025431 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995fcd8-53a7-4e75-ab7a-1ab9adfaefc9 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:08.061999 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dee4c2-e0ef-45cf-a84f-06af74ac98dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:08.062674 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dee4c2-e0ef-45cf-a84f-06af74ac98dc None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:08.062907 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dee4c2-e0ef-45cf-a84f-06af74ac98dc None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:08.063182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dee4c2-e0ef-45cf-a84f-06af74ac98dc None admin] PATH_INFO: `/v3/projects/7adb0f361d1a498f9e39b33b2bbe63ec` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:08.064402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dee4c2-e0ef-45cf-a84f-06af74ac98dc None admin] RBAC: Authorizing `identity:get_project(project_id=7adb0f361d1a498f9e39b33b2bbe63ec)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:08.066000 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dee4c2-e0ef-45cf-a84f-06af74ac98dc None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:08.068052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 196/376] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:26:07 2022] GET /identity/v3/projects/7adb0f361d1a498f9e39b33b2bbe63ec => generated 344 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:08.074013 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dee4c2-e0ef-45cf-a84f-06af74ac98dc None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:08.137062 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:08.148651 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80774e3-3a7c-40c4-8022-47481a7b3d16 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:08.182071 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:08.201246 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d778849-417d-48d6-8f96-53fcc806f43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:08.201888 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d778849-417d-48d6-8f96-53fcc806f43b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:08.202162 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d778849-417d-48d6-8f96-53fcc806f43b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:08.202427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d778849-417d-48d6-8f96-53fcc806f43b None admin] PATH_INFO: `/v3/groups/519cc8d7a5624287873ae043faef85ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:08.204785 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d778849-417d-48d6-8f96-53fcc806f43b None admin] RBAC: Authorizing `identity:get_group(group_id=519cc8d7a5624287873ae043faef85ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:08.206016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d778849-417d-48d6-8f96-53fcc806f43b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:08.207571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 181/377] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Aug 22 20:26:08 2022] GET /identity/v3/groups/519cc8d7a5624287873ae043faef85ad => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:26:08.213926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d778849-417d-48d6-8f96-53fcc806f43b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:08.265295 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dee4c2-e0ef-45cf-a84f-06af74ac98dc None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:08.306591 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb497219-a37c-4aea-8a6e-56da74b84e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:08.307274 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb497219-a37c-4aea-8a6e-56da74b84e06 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:08.307551 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb497219-a37c-4aea-8a6e-56da74b84e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:08.307970 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb497219-a37c-4aea-8a6e-56da74b84e06 None admin] PATH_INFO: `/v3/groups/066edefba0914ffa8cd1c71ecf798a0e` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:08.315278 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb497219-a37c-4aea-8a6e-56da74b84e06 None admin] RBAC: Authorizing `identity:get_group(group_id=066edefba0914ffa8cd1c71ecf798a0e)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:08.316773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb497219-a37c-4aea-8a6e-56da74b84e06 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:08.320310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 197/378] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Aug 22 20:26:08 2022] GET /identity/v3/groups/066edefba0914ffa8cd1c71ecf798a0e => generated 229 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:08.325681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb497219-a37c-4aea-8a6e-56da74b84e06 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:08.440077 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:08.455605 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb497219-a37c-4aea-8a6e-56da74b84e06 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:08.467514 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d778849-417d-48d6-8f96-53fcc806f43b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:08.504859 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19798138-8f5b-4131-b128-bcc64fafd97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:08.505473 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19798138-8f5b-4131-b128-bcc64fafd97a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:08.505753 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19798138-8f5b-4131-b128-bcc64fafd97a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:08.506025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19798138-8f5b-4131-b128-bcc64fafd97a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:08.506875 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19798138-8f5b-4131-b128-bcc64fafd97a None admin] RBAC: Adding query filter params (group.id=066edefba0914ffa8cd1c71ecf798a0e, role.id=e3faa0474c054da6bb4d8910a4e40bff, scope.project.id=7adb0f361d1a498f9e39b33b2bbe63ec) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:08.507290 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19798138-8f5b-4131-b128-bcc64fafd97a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:08.508774 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19798138-8f5b-4131-b128-bcc64fafd97a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:08.523890 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 198/379] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Aug 22 20:26:08 2022] GET /identity/v3/role_assignments?group.id=066edefba0914ffa8cd1c71ecf798a0e&scope.project.id=7adb0f361d1a498f9e39b33b2bbe63ec&role.id=e3faa0474c054da6bb4d8910a4e40bff => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:26:08.527586 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad743ad-34d9-4f37-924c-6de476430411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:08.528209 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad743ad-34d9-4f37-924c-6de476430411 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:08.528488 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad743ad-34d9-4f37-924c-6de476430411 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:08.528790 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad743ad-34d9-4f37-924c-6de476430411 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:08.529536 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad743ad-34d9-4f37-924c-6de476430411 None admin] RBAC: Adding query filter params (group.id=519cc8d7a5624287873ae043faef85ad, role.id=7f4b8cdb739c4f808ef31961eb11510e, scope.project.id=d0af86473fde40a2b26933e4ecd0901a) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:08.529845 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad743ad-34d9-4f37-924c-6de476430411 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:08.531331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad743ad-34d9-4f37-924c-6de476430411 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:08.538865 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 182/380] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Aug 22 20:26:08 2022] GET /identity/v3/role_assignments?group.id=519cc8d7a5624287873ae043faef85ad&scope.project.id=d0af86473fde40a2b26933e4ecd0901a&role.id=7f4b8cdb739c4f808ef31961eb11510e => generated 260 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:26:08.629007 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc3726-3f28-4de9-bb1d-308e507c2a28 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:08.629349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc3726-3f28-4de9-bb1d-308e507c2a28 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:08.629566 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc3726-3f28-4de9-bb1d-308e507c2a28 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:08.631208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 199/381] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:08.637116 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f175081-957c-4f23-9c34-3ae818a22686 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:08.637630 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f175081-957c-4f23-9c34-3ae818a22686 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:08.637703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f175081-957c-4f23-9c34-3ae818a22686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:08.660840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-8f175081-957c-4f23-9c34-3ae818a22686 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:08.663601 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8f175081-957c-4f23-9c34-3ae818a22686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:08.733824 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:08.748760 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 183/382] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:09.078926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc3726-3f28-4de9-bb1d-308e507c2a28 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:09.204978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc3726-3f28-4de9-bb1d-308e507c2a28 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:09.243257 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd7df0-3ab0-422a-88e2-f7e3e82a66ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:09.243886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd7df0-3ab0-422a-88e2-f7e3e82a66ac None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:09.244162 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd7df0-3ab0-422a-88e2-f7e3e82a66ac None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:09.244434 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd7df0-3ab0-422a-88e2-f7e3e82a66ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:09.259624 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd7df0-3ab0-422a-88e2-f7e3e82a66ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:09.264285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-1cdd7df0-3ab0-422a-88e2-f7e3e82a66ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:26:09.264285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:09.264285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:09.264285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:09.264285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:09.264285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:09.264285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:09.264285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:09.264285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:09.264285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:09.264285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:09.264285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:09.264285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:09.264285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:09.264285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:09.264285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:09.265161 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:09.265161 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:09.265161 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:09.265161 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:09.265161 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:09.265161 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:09.265161 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:09.265161 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:09.265161 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:09.265161 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:09.265161 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:09.265161 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:09.265161 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:09.265161 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:09.265161 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:09.265161 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:09.266340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:09.266340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:09.266340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:09.266340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:09.266340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:09.266340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:09.266340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:09.266340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:09.266340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:09.266340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:09.266340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:26:09.266340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:09.266340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 200/383] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:26:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:09.271498 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f175081-957c-4f23-9c34-3ae818a22686 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:09.407547 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f175081-957c-4f23-9c34-3ae818a22686 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:09.451806 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ead324-2d43-48f1-94a9-87c61b317103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:09.452439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ead324-2d43-48f1-94a9-87c61b317103 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:09.452745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ead324-2d43-48f1-94a9-87c61b317103 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:09.453025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ead324-2d43-48f1-94a9-87c61b317103 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:09.453744 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ead324-2d43-48f1-94a9-87c61b317103 None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:09.454012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ead324-2d43-48f1-94a9-87c61b317103 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:09.455678 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ead324-2d43-48f1-94a9-87c61b317103 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:09.465556 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 184/384] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 22 20:26:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:09.473733 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd7df0-3ab0-422a-88e2-f7e3e82a66ac None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:09.498842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:09.603625 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd7df0-3ab0-422a-88e2-f7e3e82a66ac None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:09.611687 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cc0ac-48c3-43b3-a850-155404ee83e2 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:09.611969 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cc0ac-48c3-43b3-a850-155404ee83e2 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:09.612246 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cc0ac-48c3-43b3-a850-155404ee83e2 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:09.613634 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 185/385] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:09.620254 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d76ebd-91ff-4821-8d00-c8e1108a996a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:09.620532 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d76ebd-91ff-4821-8d00-c8e1108a996a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:09.620823 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d76ebd-91ff-4821-8d00-c8e1108a996a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:09.658965 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-13d76ebd-91ff-4821-8d00-c8e1108a996a None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:09.663049 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-13d76ebd-91ff-4821-8d00-c8e1108a996a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:09.676285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f5950-de3b-4616-8717-5ac592da872a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:09.677369 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f5950-de3b-4616-8717-5ac592da872a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:09.681934 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f5950-de3b-4616-8717-5ac592da872a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:09.682472 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f5950-de3b-4616-8717-5ac592da872a None admin] PATH_INFO: `/v3/groups/519cc8d7a5624287873ae043faef85ad` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:09.683822 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f5950-de3b-4616-8717-5ac592da872a None admin] RBAC: Authorizing `identity:get_group(group_id=519cc8d7a5624287873ae043faef85ad)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:09.685517 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f5950-de3b-4616-8717-5ac592da872a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:09.688200 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 201/386] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Aug 22 20:26:09 2022] GET /identity/v3/groups/519cc8d7a5624287873ae043faef85ad => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:09.695071 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f5950-de3b-4616-8717-5ac592da872a None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:09.786852 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:09.836330 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 186/387] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:26:09.876790 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:09.901475 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f5950-de3b-4616-8717-5ac592da872a None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:09.947449 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db193cd9-37e4-4ede-8397-ed2e8900a357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:09.947999 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db193cd9-37e4-4ede-8397-ed2e8900a357 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:09.948284 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db193cd9-37e4-4ede-8397-ed2e8900a357 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:09.948554 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db193cd9-37e4-4ede-8397-ed2e8900a357 None admin] PATH_INFO: `/v3/projects/3883b1b257924533a84cbc24a92ea6e1` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:09.953422 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db193cd9-37e4-4ede-8397-ed2e8900a357 None admin] RBAC: Authorizing `identity:get_project(project_id=3883b1b257924533a84cbc24a92ea6e1)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:09.955173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db193cd9-37e4-4ede-8397-ed2e8900a357 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:09.957206 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 202/388] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:26:09 2022] GET /identity/v3/projects/3883b1b257924533a84cbc24a92ea6e1 => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:09.964158 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d76ebd-91ff-4821-8d00-c8e1108a996a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:09.977350 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f233c-4496-4a5c-84f7-b0646a1c31f3 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:09.977650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f233c-4496-4a5c-84f7-b0646a1c31f3 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:09.977911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f233c-4496-4a5c-84f7-b0646a1c31f3 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:09.979238 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 203/389] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:26:09.985604 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2d943-a059-483c-ba4d-397a46a9b693 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:09.985888 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2d943-a059-483c-ba4d-397a46a9b693 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:09.986165 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2d943-a059-483c-ba4d-397a46a9b693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:10.016531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-79c2d943-a059-483c-ba4d-397a46a9b693 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:10.018730 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-79c2d943-a059-483c-ba4d-397a46a9b693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:10.139310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 204/390] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:26:10.149900 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d76ebd-91ff-4821-8d00-c8e1108a996a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:10.193460 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5702c-444f-423a-8d5a-9ab18f5a6f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:10.194139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5702c-444f-423a-8d5a-9ab18f5a6f06 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:10.194587 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5702c-444f-423a-8d5a-9ab18f5a6f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:10.194873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5702c-444f-423a-8d5a-9ab18f5a6f06 None admin] PATH_INFO: `/v3/projects/3883b1b257924533a84cbc24a92ea6e1/groups/519cc8d7a5624287873ae043faef85ad/roles/028945f544094c26933c8ef60a480e9a` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:10.197511 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5702c-444f-423a-8d5a-9ab18f5a6f06 None admin] RBAC: Authorizing `identity:create_grant(project_id=3883b1b257924533a84cbc24a92ea6e1, group_id=519cc8d7a5624287873ae043faef85ad, role_id=028945f544094c26933c8ef60a480e9a)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:10.198885 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5702c-444f-423a-8d5a-9ab18f5a6f06 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:10.240626 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2d943-a059-483c-ba4d-397a46a9b693 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:10.269447 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 187/391] 10.222.0.62 () {58 vars in 1442 bytes} [Mon Aug 22 20:26:09 2022] PUT /identity/v3/projects/3883b1b257924533a84cbc24a92ea6e1/groups/519cc8d7a5624287873ae043faef85ad/roles/028945f544094c26933c8ef60a480e9a => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:26:10.336382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:10.360076 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2d943-a059-483c-ba4d-397a46a9b693 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:10.411187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35cc628-8c5a-4659-9334-8b097d0284ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:10.411845 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cc628-8c5a-4659-9334-8b097d0284ac None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:10.412120 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cc628-8c5a-4659-9334-8b097d0284ac None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:10.412929 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cc628-8c5a-4659-9334-8b097d0284ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:10.430549 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35cc628-8c5a-4659-9334-8b097d0284ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:10.435383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-c35cc628-8c5a-4659-9334-8b097d0284ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:26:10.435383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:10.435383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:10.435383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:10.435383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:10.435383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:10.435383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:10.435383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:10.435383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:10.435383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:10.435383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:10.435383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:10.435383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:10.435383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:10.435383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:10.435383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:10.436293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:10.436293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:10.436293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:10.436293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:10.436293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:10.436293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:10.436293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:10.436293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:10.436293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:10.436293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:10.436293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:10.436293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:10.436293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:10.436293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:10.436293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:10.436293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:10.437119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:10.437119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:10.437119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:10.437119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:10.437119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:10.437119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:10.437119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:10.437119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:10.437119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:10.437119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:10.437119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:26:10.437119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:10.437119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 205/392] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 22 20:26:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:26:10.442609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5702c-444f-423a-8d5a-9ab18f5a6f06 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:10.498726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35cc628-8c5a-4659-9334-8b097d0284ac None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:10.506236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:10.577612 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5702c-444f-423a-8d5a-9ab18f5a6f06 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:10.631111 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35cc628-8c5a-4659-9334-8b097d0284ac None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:10.647202 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2021d3a-f9a1-4940-bb12-2fbc02b1ddf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:10.648163 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2021d3a-f9a1-4940-bb12-2fbc02b1ddf0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:10.648678 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2021d3a-f9a1-4940-bb12-2fbc02b1ddf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:10.649153 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2021d3a-f9a1-4940-bb12-2fbc02b1ddf0 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:10.650083 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2021d3a-f9a1-4940-bb12-2fbc02b1ddf0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:10.650575 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2021d3a-f9a1-4940-bb12-2fbc02b1ddf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:10.654653 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2021d3a-f9a1-4940-bb12-2fbc02b1ddf0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:10.667160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 188/393] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:26:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:10.673824 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2021d3a-f9a1-4940-bb12-2fbc02b1ddf0 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:10.712171 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799358a5-98a5-49d0-9ac0-6341208c1981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:10.713177 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799358a5-98a5-49d0-9ac0-6341208c1981 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:10.713654 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799358a5-98a5-49d0-9ac0-6341208c1981 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:10.714141 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799358a5-98a5-49d0-9ac0-6341208c1981 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:10.725558 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:10.734044 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799358a5-98a5-49d0-9ac0-6341208c1981 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:10.741410 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-799358a5-98a5-49d0-9ac0-6341208c1981 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:26:10.741410 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:10.741410 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:10.741410 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:10.741410 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:10.741410 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:10.741410 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:10.741410 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:10.741410 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:10.741410 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:10.741410 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:10.741410 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:10.741410 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:10.741410 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:10.741410 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:10.741410 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:10.742360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:10.742360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:10.742360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:10.742360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:10.742360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:10.742360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:10.742360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:10.742360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:10.742360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:10.742360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:10.742360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:10.742360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:10.742360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:10.742360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:10.742360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:10.742360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:10.743124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:10.743124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:10.743124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:10.743124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:10.743124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:10.743124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:10.743124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:10.743124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:10.743124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:10.743124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:10.743124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:26:10.743124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:10.748435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 206/394] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:26:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:10.753180 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799358a5-98a5-49d0-9ac0-6341208c1981 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:10.868534 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2021d3a-f9a1-4940-bb12-2fbc02b1ddf0 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:10.871567 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:10.910956 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa622d69-321b-4d6f-92ea-06c17f5603f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:10.911599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa622d69-321b-4d6f-92ea-06c17f5603f0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:10.911939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa622d69-321b-4d6f-92ea-06c17f5603f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:10.912837 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa622d69-321b-4d6f-92ea-06c17f5603f0 None admin] PATH_INFO: `/v3/groups/519cc8d7a5624287873ae043faef85ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:10.916923 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa622d69-321b-4d6f-92ea-06c17f5603f0 None admin] RBAC: Authorizing `identity:get_group(group_id=519cc8d7a5624287873ae043faef85ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:10.918436 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa622d69-321b-4d6f-92ea-06c17f5603f0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:10.920266 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 189/395] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Aug 22 20:26:10 2022] GET /identity/v3/groups/519cc8d7a5624287873ae043faef85ad => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:10.926942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa622d69-321b-4d6f-92ea-06c17f5603f0 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:10.958388 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799358a5-98a5-49d0-9ac0-6341208c1981 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:11.024943 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b41d1a-a19c-4f30-a703-8e20b201578d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:11.025815 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b41d1a-a19c-4f30-a703-8e20b201578d None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:11.026295 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b41d1a-a19c-4f30-a703-8e20b201578d None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:11.026778 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b41d1a-a19c-4f30-a703-8e20b201578d None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:11.027459 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b41d1a-a19c-4f30-a703-8e20b201578d None admin] RBAC: Adding query filter params (name=member) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:11.028480 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b41d1a-a19c-4f30-a703-8e20b201578d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:11.030442 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b41d1a-a19c-4f30-a703-8e20b201578d None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:11.041942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 207/396] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 22 20:26:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:11.044707 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b108190-5608-4507-b989-f9fb569ce905 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:11.044707 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b108190-5608-4507-b989-f9fb569ce905 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:11.044707 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b108190-5608-4507-b989-f9fb569ce905 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:11.048752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 208/397] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:11.049660 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b108190-5608-4507-b989-f9fb569ce905 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:11.085646 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa622d69-321b-4d6f-92ea-06c17f5603f0 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:11.117794 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:11.133544 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21514a36-123b-49b6-ad52-7c950da2b2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:11.134228 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21514a36-123b-49b6-ad52-7c950da2b2bd None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:11.134511 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21514a36-123b-49b6-ad52-7c950da2b2bd None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:11.134783 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21514a36-123b-49b6-ad52-7c950da2b2bd None admin] PATH_INFO: `/v3/projects/3883b1b257924533a84cbc24a92ea6e1` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:11.136046 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21514a36-123b-49b6-ad52-7c950da2b2bd None admin] RBAC: Authorizing `identity:get_project(project_id=3883b1b257924533a84cbc24a92ea6e1)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:11.137549 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21514a36-123b-49b6-ad52-7c950da2b2bd None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:11.139543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 190/398] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:26:10 2022] GET /identity/v3/projects/3883b1b257924533a84cbc24a92ea6e1 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:26:11.140777 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e829261-6832-4a76-ace5-4814912c2456 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:11.141110 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e829261-6832-4a76-ace5-4814912c2456 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:11.141385 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e829261-6832-4a76-ace5-4814912c2456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:11.162442 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-1e829261-6832-4a76-ace5-4814912c2456 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:11.163848 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1e829261-6832-4a76-ace5-4814912c2456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:11.166940 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b108190-5608-4507-b989-f9fb569ce905 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:11.196996 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:11.202476 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27cb082-e507-4208-ba65-f43bce5471ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:11.203123 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cb082-e507-4208-ba65-f43bce5471ee None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:11.203385 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cb082-e507-4208-ba65-f43bce5471ee None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:11.203658 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cb082-e507-4208-ba65-f43bce5471ee None admin] PATH_INFO: `/v3/groups/519cc8d7a5624287873ae043faef85ad` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:11.205062 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27cb082-e507-4208-ba65-f43bce5471ee None admin] RBAC: Authorizing `identity:get_group(group_id=519cc8d7a5624287873ae043faef85ad)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:11.206494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27cb082-e507-4208-ba65-f43bce5471ee None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:11.208047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 209/399] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Aug 22 20:26:11 2022] GET /identity/v3/groups/519cc8d7a5624287873ae043faef85ad => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:11.208797 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27cb082-e507-4208-ba65-f43bce5471ee None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:11.248695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 191/400] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:11.248695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f79c65-0154-4f65-8bcd-1dbf67a29cdf None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:11.248695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f79c65-0154-4f65-8bcd-1dbf67a29cdf None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:11.248695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f79c65-0154-4f65-8bcd-1dbf67a29cdf None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:11.248695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 192/401] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:11.248695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f79c65-0154-4f65-8bcd-1dbf67a29cdf None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:11.328937 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27cb082-e507-4208-ba65-f43bce5471ee None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:11.362039 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:11.368037 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f79c65-0154-4f65-8bcd-1dbf67a29cdf None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:11.371418 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c18ab-1173-4cdc-81f0-bcf453247c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:11.372160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c18ab-1173-4cdc-81f0-bcf453247c4f None admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:11.379621 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c18ab-1173-4cdc-81f0-bcf453247c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:11.379621 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c18ab-1173-4cdc-81f0-bcf453247c4f None admin] PATH_INFO: `/v3/projects/3883b1b257924533a84cbc24a92ea6e1/groups/519cc8d7a5624287873ae043faef85ad/roles/7f4b8cdb739c4f808ef31961eb11510e` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:11.379621 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c18ab-1173-4cdc-81f0-bcf453247c4f None admin] RBAC: Authorizing `identity:create_grant(project_id=3883b1b257924533a84cbc24a92ea6e1, group_id=519cc8d7a5624287873ae043faef85ad, role_id=7f4b8cdb739c4f808ef31961eb11510e)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:11.379621 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c18ab-1173-4cdc-81f0-bcf453247c4f None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:11.404496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb02c6-a6fd-40ac-b49d-cd2a9c6c52e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:11.409194 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb02c6-a6fd-40ac-b49d-cd2a9c6c52e1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:11.409194 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb02c6-a6fd-40ac-b49d-cd2a9c6c52e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:11.409194 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb02c6-a6fd-40ac-b49d-cd2a9c6c52e1 None admin] PATH_INFO: `/v3/projects/d0af86473fde40a2b26933e4ecd0901a` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:11.409194 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb02c6-a6fd-40ac-b49d-cd2a9c6c52e1 None admin] RBAC: Authorizing `identity:get_project(project_id=d0af86473fde40a2b26933e4ecd0901a)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:11.409194 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb02c6-a6fd-40ac-b49d-cd2a9c6c52e1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:11.415354 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 193/402] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:26:11 2022] GET /identity/v3/projects/d0af86473fde40a2b26933e4ecd0901a => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:11.416514 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366ceaa-06a9-4519-8516-ffa4743fef8a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:11.416818 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366ceaa-06a9-4519-8516-ffa4743fef8a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:11.417090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366ceaa-06a9-4519-8516-ffa4743fef8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:11.434627 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-b366ceaa-06a9-4519-8516-ffa4743fef8a None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:11.435790 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b366ceaa-06a9-4519-8516-ffa4743fef8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:11.460718 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 210/403] 10.222.0.62 () {58 vars in 1442 bytes} [Mon Aug 22 20:26:11 2022] PUT /identity/v3/projects/3883b1b257924533a84cbc24a92ea6e1/groups/519cc8d7a5624287873ae043faef85ad/roles/7f4b8cdb739c4f808ef31961eb11510e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:26:11.462378 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c18ab-1173-4cdc-81f0-bcf453247c4f None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:11.470704 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:11.548471 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 194/404] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:11.549225 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366ceaa-06a9-4519-8516-ffa4743fef8a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:11.669972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c18ab-1173-4cdc-81f0-bcf453247c4f None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:11.722262 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bc16d-6c46-4793-9d09-c4f18e7a43c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:11.724486 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366ceaa-06a9-4519-8516-ffa4743fef8a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:11.729436 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bc16d-6c46-4793-9d09-c4f18e7a43c7 None admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:11.729723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bc16d-6c46-4793-9d09-c4f18e7a43c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:11.730006 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bc16d-6c46-4793-9d09-c4f18e7a43c7 None admin] PATH_INFO: `/v3/projects/d0af86473fde40a2b26933e4ecd0901a/groups/519cc8d7a5624287873ae043faef85ad/roles/028945f544094c26933c8ef60a480e9a` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:11.737409 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1bc16d-6c46-4793-9d09-c4f18e7a43c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0af86473fde40a2b26933e4ecd0901a, group_id=519cc8d7a5624287873ae043faef85ad, role_id=028945f544094c26933c8ef60a480e9a)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:11.740115 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1bc16d-6c46-4793-9d09-c4f18e7a43c7 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:11.769957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b46c1a-3e64-4fef-ba99-167ac7b22f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:11.774284 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b46c1a-3e64-4fef-ba99-167ac7b22f35 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:11.774284 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b46c1a-3e64-4fef-ba99-167ac7b22f35 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:11.774284 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b46c1a-3e64-4fef-ba99-167ac7b22f35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:11.783045 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b46c1a-3e64-4fef-ba99-167ac7b22f35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:11.788692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-f6b46c1a-3e64-4fef-ba99-167ac7b22f35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:26:11.788692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:11.788692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:11.788692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:11.788692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:11.788692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:11.788692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:11.788692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:11.788692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:11.788692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:11.788692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:11.788692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:11.788692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:11.788692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:11.788692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:11.788692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:11.789745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:11.789745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:11.789745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:11.789745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:11.789745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:11.789745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:11.789745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:11.789745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:11.789745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:11.789745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:11.789745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:11.789745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:11.789745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:11.789745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:11.789745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:11.789745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:11.790723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:11.790723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:11.790723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:11.790723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:11.790723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:11.790723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:11.790723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:11.790723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:11.790723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:11.790723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:11.790723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:26:11.790723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:11.792472 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 195/405] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 22 20:26:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:11.797463 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b46c1a-3e64-4fef-ba99-167ac7b22f35 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:11.833167 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:11.858650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 211/406] 10.222.0.62 () {58 vars in 1442 bytes} [Mon Aug 22 20:26:11 2022] PUT /identity/v3/projects/d0af86473fde40a2b26933e4ecd0901a/groups/519cc8d7a5624287873ae043faef85ad/roles/028945f544094c26933c8ef60a480e9a => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:26:11.859574 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bc16d-6c46-4793-9d09-c4f18e7a43c7 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:11.952872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b46c1a-3e64-4fef-ba99-167ac7b22f35 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:11.976619 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:12.000535 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed97a1-d486-4174-94eb-7abb7271e30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:12.001558 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed97a1-d486-4174-94eb-7abb7271e30e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:12.002892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed97a1-d486-4174-94eb-7abb7271e30e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:12.003590 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebed97a1-d486-4174-94eb-7abb7271e30e None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:12.006069 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed97a1-d486-4174-94eb-7abb7271e30e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:12.006591 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed97a1-d486-4174-94eb-7abb7271e30e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:12.008211 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebed97a1-d486-4174-94eb-7abb7271e30e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:12.022201 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 196/407] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:26:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:26:12.028100 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed97a1-d486-4174-94eb-7abb7271e30e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:12.062082 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bc16d-6c46-4793-9d09-c4f18e7a43c7 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:12.103850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1a92a-646b-40f3-be40-106b6efd5870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:12.104483 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1a92a-646b-40f3-be40-106b6efd5870 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:12.104814 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1a92a-646b-40f3-be40-106b6efd5870 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:12.105162 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1a92a-646b-40f3-be40-106b6efd5870 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:12.117773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1a92a-646b-40f3-be40-106b6efd5870 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:12.123129 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-c9f1a92a-646b-40f3-be40-106b6efd5870 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:26:12.123129 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:12.123129 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:12.123129 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:12.123129 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:12.123129 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:12.123129 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:12.123129 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:12.123129 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:12.123129 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:12.123129 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:12.123129 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:12.123129 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:12.123129 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:12.123129 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:12.123129 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:12.124226 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:12.124226 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:12.124226 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:12.124226 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:12.124226 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:12.124226 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:12.124226 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:12.124226 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:12.124226 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:12.124226 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:12.124226 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:12.124226 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:12.124226 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:12.124226 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:12.124226 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:12.124226 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:12.125251 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:12.125251 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:12.125251 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:12.125251 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:12.125251 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:12.125251 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:12.125251 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:12.125251 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:12.125251 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:12.125251 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:12.125251 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:26:12.125251 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:12.125251 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 212/408] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 22 20:26:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:12.132496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1a92a-646b-40f3-be40-106b6efd5870 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:12.144596 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:12.165987 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebed97a1-d486-4174-94eb-7abb7271e30e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:12.217399 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f0094-4a02-4e11-928b-fafb07ea5d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:12.217954 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f0094-4a02-4e11-928b-fafb07ea5d0b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:12.218232 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f0094-4a02-4e11-928b-fafb07ea5d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:12.218507 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f0094-4a02-4e11-928b-fafb07ea5d0b None admin] PATH_INFO: `/v3/groups/066edefba0914ffa8cd1c71ecf798a0e` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:12.219639 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f0094-4a02-4e11-928b-fafb07ea5d0b None admin] RBAC: Authorizing `identity:get_group(group_id=066edefba0914ffa8cd1c71ecf798a0e)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:12.221710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f0094-4a02-4e11-928b-fafb07ea5d0b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:12.224172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 197/409] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Aug 22 20:26:12 2022] GET /identity/v3/groups/066edefba0914ffa8cd1c71ecf798a0e => generated 229 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:12.229874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f0094-4a02-4e11-928b-fafb07ea5d0b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:12.260684 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1a92a-646b-40f3-be40-106b6efd5870 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:12.278579 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:12.324306 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e3444-f29b-4027-bc22-bd17e0772889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:12.324963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e3444-f29b-4027-bc22-bd17e0772889 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:12.325243 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e3444-f29b-4027-bc22-bd17e0772889 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:12.325514 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e3444-f29b-4027-bc22-bd17e0772889 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:12.326184 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e3444-f29b-4027-bc22-bd17e0772889 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:12.326494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e3444-f29b-4027-bc22-bd17e0772889 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:12.327885 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e3444-f29b-4027-bc22-bd17e0772889 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:12.346097 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f0094-4a02-4e11-928b-fafb07ea5d0b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:12.346294 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 213/410] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:26:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:26:12.365211 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e3444-f29b-4027-bc22-bd17e0772889 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:12.398268 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc2427-98dc-4481-be24-569768da91c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:12.399533 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc2427-98dc-4481-be24-569768da91c1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:12.399988 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc2427-98dc-4481-be24-569768da91c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:12.400417 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc2427-98dc-4481-be24-569768da91c1 None admin] PATH_INFO: `/v3/projects/7adb0f361d1a498f9e39b33b2bbe63ec` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:12.401762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc2427-98dc-4481-be24-569768da91c1 None admin] RBAC: Authorizing `identity:get_project(project_id=7adb0f361d1a498f9e39b33b2bbe63ec)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:12.403411 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc2427-98dc-4481-be24-569768da91c1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:12.405788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 198/411] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:26:12 2022] GET /identity/v3/projects/7adb0f361d1a498f9e39b33b2bbe63ec => generated 344 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:26:12.411793 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc2427-98dc-4481-be24-569768da91c1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:12.475368 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:12.509300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e3444-f29b-4027-bc22-bd17e0772889 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:12.555415 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a60dab-e832-4d4e-ac2e-ab3dae960e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:12.556249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a60dab-e832-4d4e-ac2e-ab3dae960e3a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:12.556634 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a60dab-e832-4d4e-ac2e-ab3dae960e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:12.557041 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a60dab-e832-4d4e-ac2e-ab3dae960e3a None admin] PATH_INFO: `/v3/groups/519cc8d7a5624287873ae043faef85ad` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:12.558524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a60dab-e832-4d4e-ac2e-ab3dae960e3a None admin] RBAC: Authorizing `identity:get_group(group_id=519cc8d7a5624287873ae043faef85ad)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:12.560097 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a60dab-e832-4d4e-ac2e-ab3dae960e3a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:12.562512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 214/412] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Aug 22 20:26:12 2022] GET /identity/v3/groups/519cc8d7a5624287873ae043faef85ad => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:26:12.563891 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec9784-0edf-409d-90e5-c0ca714ec8a5 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:12.564274 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec9784-0edf-409d-90e5-c0ca714ec8a5 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:12.564647 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec9784-0edf-409d-90e5-c0ca714ec8a5 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:12.570912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 215/413] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:12.572010 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec9784-0edf-409d-90e5-c0ca714ec8a5 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:12.582665 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc2427-98dc-4481-be24-569768da91c1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:12.620844 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcc688-3452-4b22-aecf-89f9e662dde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:12.621512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcc688-3452-4b22-aecf-89f9e662dde9 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:12.621792 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcc688-3452-4b22-aecf-89f9e662dde9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:12.622070 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcc688-3452-4b22-aecf-89f9e662dde9 None admin] PATH_INFO: `/v3/projects/7adb0f361d1a498f9e39b33b2bbe63ec/groups/066edefba0914ffa8cd1c71ecf798a0e/roles/e3faa0474c054da6bb4d8910a4e40bff` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:12.623995 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affcc688-3452-4b22-aecf-89f9e662dde9 None admin] RBAC: Authorizing `identity:create_grant(project_id=7adb0f361d1a498f9e39b33b2bbe63ec, group_id=066edefba0914ffa8cd1c71ecf798a0e, role_id=e3faa0474c054da6bb4d8910a4e40bff)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:12.625514 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affcc688-3452-4b22-aecf-89f9e662dde9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:12.633170 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:12.773534 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 199/414] 10.222.0.62 () {58 vars in 1442 bytes} [Mon Aug 22 20:26:12 2022] PUT /identity/v3/projects/7adb0f361d1a498f9e39b33b2bbe63ec/groups/066edefba0914ffa8cd1c71ecf798a0e/roles/e3faa0474c054da6bb4d8910a4e40bff => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:26:12.775449 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fb58b-74c9-427f-974d-1591c066c013 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:12.775733 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fb58b-74c9-427f-974d-1591c066c013 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:12.775999 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fb58b-74c9-427f-974d-1591c066c013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:12.803466 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-2e0fb58b-74c9-427f-974d-1591c066c013 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:12.804835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2e0fb58b-74c9-427f-974d-1591c066c013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:12.811216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec9784-0edf-409d-90e5-c0ca714ec8a5 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:12.917867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 200/415] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:12.937450 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7357fdb-9f75-4530-845c-c23d506e1823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:12.938120 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7357fdb-9f75-4530-845c-c23d506e1823 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:12.938400 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7357fdb-9f75-4530-845c-c23d506e1823 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:12.938675 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7357fdb-9f75-4530-845c-c23d506e1823 None admin] PATH_INFO: `/v3/projects/d0af86473fde40a2b26933e4ecd0901a` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:12.939893 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7357fdb-9f75-4530-845c-c23d506e1823 None admin] RBAC: Authorizing `identity:get_project(project_id=d0af86473fde40a2b26933e4ecd0901a)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:12.941371 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7357fdb-9f75-4530-845c-c23d506e1823 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:12.943932 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 216/416] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:26:12 2022] GET /identity/v3/projects/d0af86473fde40a2b26933e4ecd0901a => generated 302 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:12.950270 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fb58b-74c9-427f-974d-1591c066c013 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:12.968835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:13.089995 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fb58b-74c9-427f-974d-1591c066c013 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:13.146032 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec11fc-4f8a-459d-a0a6-7e30e068edf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:13.148075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec11fc-4f8a-459d-a0a6-7e30e068edf8 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:13.148855 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec11fc-4f8a-459d-a0a6-7e30e068edf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:13.149323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec11fc-4f8a-459d-a0a6-7e30e068edf8 None admin] PATH_INFO: `/v3/projects/d0af86473fde40a2b26933e4ecd0901a/groups/519cc8d7a5624287873ae043faef85ad/roles/7f4b8cdb739c4f808ef31961eb11510e` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:13.154669 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec11fc-4f8a-459d-a0a6-7e30e068edf8 None admin] RBAC: Authorizing `identity:create_grant(project_id=d0af86473fde40a2b26933e4ecd0901a, group_id=519cc8d7a5624287873ae043faef85ad, role_id=7f4b8cdb739c4f808ef31961eb11510e)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:13.156340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec11fc-4f8a-459d-a0a6-7e30e068edf8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:13.242696 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 201/417] 10.222.0.62 () {58 vars in 1442 bytes} [Mon Aug 22 20:26:12 2022] PUT /identity/v3/projects/d0af86473fde40a2b26933e4ecd0901a/groups/519cc8d7a5624287873ae043faef85ad/roles/7f4b8cdb739c4f808ef31961eb11510e => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:26:13.244203 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7357fdb-9f75-4530-845c-c23d506e1823 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:13.406150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7357fdb-9f75-4530-845c-c23d506e1823 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:13.419192 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:13.448991 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60c37c-db26-4793-92d9-874a33601e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:13.449615 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60c37c-db26-4793-92d9-874a33601e08 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:13.449889 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60c37c-db26-4793-92d9-874a33601e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:13.450155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60c37c-db26-4793-92d9-874a33601e08 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:13.462289 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60c37c-db26-4793-92d9-874a33601e08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:13.466886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-2a60c37c-db26-4793-92d9-874a33601e08 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:26:13.466886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:13.466886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:13.466886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:13.466886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:13.466886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:13.466886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:13.466886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:13.466886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:13.466886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:13.466886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:13.466886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:13.466886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:13.466886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:13.466886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:13.466886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:13.467788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:13.467788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:13.467788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:13.467788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:13.467788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:13.467788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:13.467788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:13.467788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:13.467788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:13.467788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:13.467788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:13.467788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:13.467788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:13.467788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:13.467788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:13.467788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:13.468599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:13.468599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:13.468599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:13.468599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:13.468599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:13.468599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:13.468599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:13.468599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:13.468599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:13.468599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:13.468599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:26:13.468599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:13.472778 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 217/418] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:26:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:26:13.474110 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec11fc-4f8a-459d-a0a6-7e30e068edf8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:13.566724 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:13.606207 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec11fc-4f8a-459d-a0a6-7e30e068edf8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:13.661524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a635026-b6ad-4731-950f-2b5a68027531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:13.662114 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a635026-b6ad-4731-950f-2b5a68027531 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:13.662386 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a635026-b6ad-4731-950f-2b5a68027531 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:13.662651 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a635026-b6ad-4731-950f-2b5a68027531 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:13.663320 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a635026-b6ad-4731-950f-2b5a68027531 None admin] RBAC: Adding query filter params (name=member) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:13.663617 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a635026-b6ad-4731-950f-2b5a68027531 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:13.665229 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a635026-b6ad-4731-950f-2b5a68027531 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:13.682001 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 202/419] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 22 20:26:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:13.689842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60c37c-db26-4793-92d9-874a33601e08 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:13.863327 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60c37c-db26-4793-92d9-874a33601e08 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:13.914853 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9efc5cc-a42e-45ad-a15e-1804e076d2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:13.915803 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efc5cc-a42e-45ad-a15e-1804e076d2c3 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:13.916293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efc5cc-a42e-45ad-a15e-1804e076d2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:13.916828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9efc5cc-a42e-45ad-a15e-1804e076d2c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:13.962713 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:13.998892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9efc5cc-a42e-45ad-a15e-1804e076d2c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:14.000440 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9efc5cc-a42e-45ad-a15e-1804e076d2c3 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:14.087280 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f20d8-ba96-438b-863a-d54d5071650e None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:14.088266 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f20d8-ba96-438b-863a-d54d5071650e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:14.088776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f20d8-ba96-438b-863a-d54d5071650e None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:14.090584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 203/420] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:14.101991 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d53c0-5186-423e-bdab-da6db84dd2ff None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:14.102567 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d53c0-5186-423e-bdab-da6db84dd2ff None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:14.103063 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d53c0-5186-423e-bdab-da6db84dd2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:14.113056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 218/421] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:26:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:26:14.121794 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9efc5cc-a42e-45ad-a15e-1804e076d2c3 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:14.141128 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-ec1d53c0-5186-423e-bdab-da6db84dd2ff None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:14.142315 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ec1d53c0-5186-423e-bdab-da6db84dd2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:14.217169 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:14.274003 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 204/422] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:14.280040 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9efc5cc-a42e-45ad-a15e-1804e076d2c3 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:14.322224 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aceabd-081c-4c2a-ad06-fcaa9061c308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:14.322857 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aceabd-081c-4c2a-ad06-fcaa9061c308 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:14.323134 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aceabd-081c-4c2a-ad06-fcaa9061c308 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:14.323406 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aceabd-081c-4c2a-ad06-fcaa9061c308 None admin] PATH_INFO: `/v3/projects/3883b1b257924533a84cbc24a92ea6e1` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:14.329683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aceabd-081c-4c2a-ad06-fcaa9061c308 None admin] RBAC: Authorizing `identity:get_project(project_id=3883b1b257924533a84cbc24a92ea6e1)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:14.331137 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aceabd-081c-4c2a-ad06-fcaa9061c308 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:14.332872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 219/423] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:26:14 2022] GET /identity/v3/projects/3883b1b257924533a84cbc24a92ea6e1 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:26:14.338664 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d53c0-5186-423e-bdab-da6db84dd2ff None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:14.364357 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180d7c3-2bd0-4f0e-80cd-9ff9f9eb0333 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:14.364700 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180d7c3-2bd0-4f0e-80cd-9ff9f9eb0333 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:14.364940 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180d7c3-2bd0-4f0e-80cd-9ff9f9eb0333 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:14.367676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 220/424] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:14.372995 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8728992-be22-4ae5-82ff-08fa376b0ccb None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:14.373256 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8728992-be22-4ae5-82ff-08fa376b0ccb None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:14.373529 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8728992-be22-4ae5-82ff-08fa376b0ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:14.398323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-d8728992-be22-4ae5-82ff-08fa376b0ccb None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:14.399516 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-d8728992-be22-4ae5-82ff-08fa376b0ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:14.454346 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:14.508084 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 221/425] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:26:14.519025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d53c0-5186-423e-bdab-da6db84dd2ff None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:14.554253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c250b34-1132-447c-b64a-05cd2d3d1d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:14.554874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c250b34-1132-447c-b64a-05cd2d3d1d31 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:14.555149 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c250b34-1132-447c-b64a-05cd2d3d1d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:14.555416 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c250b34-1132-447c-b64a-05cd2d3d1d31 None admin] PATH_INFO: `/v3/groups/519cc8d7a5624287873ae043faef85ad` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:14.556519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c250b34-1132-447c-b64a-05cd2d3d1d31 None admin] RBAC: Authorizing `identity:get_group(group_id=519cc8d7a5624287873ae043faef85ad)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:14.557978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c250b34-1132-447c-b64a-05cd2d3d1d31 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:14.564317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 205/426] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Aug 22 20:26:14 2022] GET /identity/v3/groups/519cc8d7a5624287873ae043faef85ad => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:14.565689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8728992-be22-4ae5-82ff-08fa376b0ccb None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:14.575808 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c250b34-1132-447c-b64a-05cd2d3d1d31 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:14.678932 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:14.746087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8728992-be22-4ae5-82ff-08fa376b0ccb None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:14.757400 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c250b34-1132-447c-b64a-05cd2d3d1d31 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:14.812106 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada0a60-1ead-48d4-836b-83866d1101eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:14.814051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada0a60-1ead-48d4-836b-83866d1101eb None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:14.815504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada0a60-1ead-48d4-836b-83866d1101eb None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:14.816612 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada0a60-1ead-48d4-836b-83866d1101eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:14.818578 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada0a60-1ead-48d4-836b-83866d1101eb None admin] RBAC: Adding query filter params (group.id=519cc8d7a5624287873ae043faef85ad, role.id=028945f544094c26933c8ef60a480e9a, scope.project.id=3883b1b257924533a84cbc24a92ea6e1) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:14.819218 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada0a60-1ead-48d4-836b-83866d1101eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:14.821821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada0a60-1ead-48d4-836b-83866d1101eb None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:14.826596 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09406c-07ea-4b12-ad81-95e8fda357c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:14.827435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09406c-07ea-4b12-ad81-95e8fda357c8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:14.827894 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09406c-07ea-4b12-ad81-95e8fda357c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:14.828339 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09406c-07ea-4b12-ad81-95e8fda357c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:14.830740 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:14.840683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 222/427] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Aug 22 20:26:14 2022] GET /identity/v3/role_assignments?group.id=519cc8d7a5624287873ae043faef85ad&scope.project.id=3883b1b257924533a84cbc24a92ea6e1&role.id=028945f544094c26933c8ef60a480e9a => generated 611 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:14.840683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada0a60-1ead-48d4-836b-83866d1101eb None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:14.855110 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de09406c-07ea-4b12-ad81-95e8fda357c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:14.860323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-de09406c-07ea-4b12-ad81-95e8fda357c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:26:14.860323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:14.860323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:14.860323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:14.860323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:14.860323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:14.860323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:14.860323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:14.860323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:14.860323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:14.860323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:14.860323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:14.860323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:14.860323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:14.860323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:14.860323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:14.861216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:14.861216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:14.861216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:14.861216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:14.861216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:14.861216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:14.861216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:14.861216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:14.861216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:14.861216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:14.861216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:14.861216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:14.861216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:14.861216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:14.861216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:14.861216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:14.861978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:14.861978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:14.861978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:14.861978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:14.861978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:14.861978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:14.861978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:14.861978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:14.861978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:14.861978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:14.861978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:26:14.861978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:14.866446 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 206/428] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 22 20:26:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:26:14.873328 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09406c-07ea-4b12-ad81-95e8fda357c8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:15.001618 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada0a60-1ead-48d4-836b-83866d1101eb None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:15.049052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:15.060592 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a7489-f7ff-4f5b-af06-8e58fbd3232f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:15.063124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09406c-07ea-4b12-ad81-95e8fda357c8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:15.063233 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a7489-f7ff-4f5b-af06-8e58fbd3232f None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:15.063233 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a7489-f7ff-4f5b-af06-8e58fbd3232f None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:15.063233 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a7489-f7ff-4f5b-af06-8e58fbd3232f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:15.074980 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066a7489-f7ff-4f5b-af06-8e58fbd3232f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:15.081721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-066a7489-f7ff-4f5b-af06-8e58fbd3232f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:26:15.081721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:15.081721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:15.081721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:15.081721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:15.081721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:15.081721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:15.081721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:15.081721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:15.081721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:15.081721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:15.081721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:15.081721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:15.081721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:15.081721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:15.081721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:15.082576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:15.082576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:15.082576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:15.082576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:15.082576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:15.082576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:15.082576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:15.082576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:15.082576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:15.082576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:15.082576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:15.082576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:15.082576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:15.082576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:15.082576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:15.082576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:15.083348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:15.083348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:15.083348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:15.083348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:15.083348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:15.083348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:15.083348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:15.083348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:15.083348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:15.083348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:15.083348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 20:26:15.083348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:15.088830 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 223/429] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:26:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:15.092048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a7489-f7ff-4f5b-af06-8e58fbd3232f None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:15.119098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12929cc6-f188-4b52-a8a8-bf8e37cf3c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:15.119792 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12929cc6-f188-4b52-a8a8-bf8e37cf3c2a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:15.120005 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12929cc6-f188-4b52-a8a8-bf8e37cf3c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:15.120357 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12929cc6-f188-4b52-a8a8-bf8e37cf3c2a None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:15.121065 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12929cc6-f188-4b52-a8a8-bf8e37cf3c2a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:15.121364 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12929cc6-f188-4b52-a8a8-bf8e37cf3c2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:15.122852 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12929cc6-f188-4b52-a8a8-bf8e37cf3c2a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:15.133818 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 207/430] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:26:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:26:15.141428 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12929cc6-f188-4b52-a8a8-bf8e37cf3c2a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:15.205464 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:15.227433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a7489-f7ff-4f5b-af06-8e58fbd3232f None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:15.276876 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12929cc6-f188-4b52-a8a8-bf8e37cf3c2a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:15.286270 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afaf58-5682-4d2f-bd71-3670b6ad9a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:15.287327 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afaf58-5682-4d2f-bd71-3670b6ad9a14 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:15.287799 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afaf58-5682-4d2f-bd71-3670b6ad9a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:15.288273 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afaf58-5682-4d2f-bd71-3670b6ad9a14 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:15.289339 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afaf58-5682-4d2f-bd71-3670b6ad9a14 None admin] RBAC: Adding query filter params (name=member) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:15.289846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afaf58-5682-4d2f-bd71-3670b6ad9a14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:15.291518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afaf58-5682-4d2f-bd71-3670b6ad9a14 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:15.308104 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 224/431] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 22 20:26:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:15.309790 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afaf58-5682-4d2f-bd71-3670b6ad9a14 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:15.321546 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c346c64-9e34-419b-bc45-cb3f65fc54d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:15.322782 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c346c64-9e34-419b-bc45-cb3f65fc54d6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:15.323068 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c346c64-9e34-419b-bc45-cb3f65fc54d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:15.323343 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c346c64-9e34-419b-bc45-cb3f65fc54d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:15.378805 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:15.424076 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c346c64-9e34-419b-bc45-cb3f65fc54d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:15.425604 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c346c64-9e34-419b-bc45-cb3f65fc54d6 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:15.449961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afaf58-5682-4d2f-bd71-3670b6ad9a14 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:15.492985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:15.502823 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422399f1-f47b-415b-bb73-a3d60f1a59fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:15.503458 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422399f1-f47b-415b-bb73-a3d60f1a59fb None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:15.503742 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422399f1-f47b-415b-bb73-a3d60f1a59fb None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:15.504015 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422399f1-f47b-415b-bb73-a3d60f1a59fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:15.563150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 208/432] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:26:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:26:15.564166 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3af9d-2278-43b8-87d4-cf2a8b98c3d5 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:15.564456 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3af9d-2278-43b8-87d4-cf2a8b98c3d5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:15.572745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3af9d-2278-43b8-87d4-cf2a8b98c3d5 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:15.572745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 209/433] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:15.573705 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3af9d-2278-43b8-87d4-cf2a8b98c3d5 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:15.600971 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422399f1-f47b-415b-bb73-a3d60f1a59fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:15.602425 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422399f1-f47b-415b-bb73-a3d60f1a59fb None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:15.653086 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:15.694334 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3af9d-2278-43b8-87d4-cf2a8b98c3d5 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:15.704750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 225/434] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:26:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 20:26:15.704750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2813a-eb90-4971-be08-72846c5db104 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:15.704750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2813a-eb90-4971-be08-72846c5db104 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:15.704750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2813a-eb90-4971-be08-72846c5db104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:15.723790 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-ecd2813a-eb90-4971-be08-72846c5db104 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:15.725585 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-ecd2813a-eb90-4971-be08-72846c5db104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:15.730687 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3ca3b-6ced-4cf0-a1c7-f7855ddbb74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:15.731317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3ca3b-6ced-4cf0-a1c7-f7855ddbb74e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:15.731596 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3ca3b-6ced-4cf0-a1c7-f7855ddbb74e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:15.731879 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3ca3b-6ced-4cf0-a1c7-f7855ddbb74e None admin] PATH_INFO: `/v3/projects/3883b1b257924533a84cbc24a92ea6e1` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:15.733044 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f3ca3b-6ced-4cf0-a1c7-f7855ddbb74e None admin] RBAC: Authorizing `identity:get_project(project_id=3883b1b257924533a84cbc24a92ea6e1)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:15.734476 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f3ca3b-6ced-4cf0-a1c7-f7855ddbb74e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:15.736082 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 210/435] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:26:15 2022] GET /identity/v3/projects/3883b1b257924533a84cbc24a92ea6e1 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:15.737200 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4add8-5dcb-4eb2-b8c5-25d0b0163473 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:15.737488 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4add8-5dcb-4eb2-b8c5-25d0b0163473 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:15.737756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4add8-5dcb-4eb2-b8c5-25d0b0163473 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:15.743376 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 211/436] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:15.744361 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4add8-5dcb-4eb2-b8c5-25d0b0163473 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:15.768866 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:15.796524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 226/437] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:15.797436 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2813a-eb90-4971-be08-72846c5db104 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:15.861848 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4add8-5dcb-4eb2-b8c5-25d0b0163473 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:15.882465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:15.899355 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063379d-5105-4778-8a6a-b9b0eca53942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:15.900076 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063379d-5105-4778-8a6a-b9b0eca53942 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:15.900352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063379d-5105-4778-8a6a-b9b0eca53942 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:15.900618 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063379d-5105-4778-8a6a-b9b0eca53942 None admin] PATH_INFO: `/v3/projects/d0af86473fde40a2b26933e4ecd0901a` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:15.901750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063379d-5105-4778-8a6a-b9b0eca53942 None admin] RBAC: Authorizing `identity:get_project(project_id=d0af86473fde40a2b26933e4ecd0901a)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:15.903242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063379d-5105-4778-8a6a-b9b0eca53942 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:15.904576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2813a-eb90-4971-be08-72846c5db104 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:15.905072 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 212/438] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:26:15 2022] GET /identity/v3/projects/d0af86473fde40a2b26933e4ecd0901a => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:15.906041 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9a9f1-060c-4b43-95f2-d888feac22fd None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:15.906326 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9a9f1-060c-4b43-95f2-d888feac22fd None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:15.906596 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9a9f1-060c-4b43-95f2-d888feac22fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:15.925199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-7ad9a9f1-060c-4b43-95f2-d888feac22fd None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:15.926391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7ad9a9f1-060c-4b43-95f2-d888feac22fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:15.945319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf8f27-024f-4690-b7f6-f41b67c1da8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:15.945942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf8f27-024f-4690-b7f6-f41b67c1da8c None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:15.946222 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf8f27-024f-4690-b7f6-f41b67c1da8c None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:15.946492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf8f27-024f-4690-b7f6-f41b67c1da8c None admin] PATH_INFO: `/v3/groups/519cc8d7a5624287873ae043faef85ad` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:15.947833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf8f27-024f-4690-b7f6-f41b67c1da8c None admin] RBAC: Authorizing `identity:get_group(group_id=519cc8d7a5624287873ae043faef85ad)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:15.949041 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf8f27-024f-4690-b7f6-f41b67c1da8c None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:15.950658 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 227/439] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Aug 22 20:26:15 2022] GET /identity/v3/groups/519cc8d7a5624287873ae043faef85ad => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:15.951811 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf8f27-024f-4690-b7f6-f41b67c1da8c None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:16.009232 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 213/440] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:16.010449 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9a9f1-060c-4b43-95f2-d888feac22fd None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:16.042807 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:16.074784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf8f27-024f-4690-b7f6-f41b67c1da8c None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:16.111360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4cd0a4-8ef4-4196-a414-f86865686270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:16.112312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cd0a4-8ef4-4196-a414-f86865686270 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:16.112525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cd0a4-8ef4-4196-a414-f86865686270 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:16.112831 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cd0a4-8ef4-4196-a414-f86865686270 None admin] PATH_INFO: `/v3/groups/519cc8d7a5624287873ae043faef85ad` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:16.113923 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4cd0a4-8ef4-4196-a414-f86865686270 None admin] RBAC: Authorizing `identity:get_group(group_id=519cc8d7a5624287873ae043faef85ad)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:16.115468 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4cd0a4-8ef4-4196-a414-f86865686270 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:16.117374 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 228/441] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Aug 22 20:26:15 2022] GET /identity/v3/groups/519cc8d7a5624287873ae043faef85ad => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:16.118129 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4cd0a4-8ef4-4196-a414-f86865686270 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:16.132690 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9a9f1-060c-4b43-95f2-d888feac22fd None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:16.139326 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:16.167715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534ce2a-70ce-4282-b310-366ea8c9c8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:16.168320 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534ce2a-70ce-4282-b310-366ea8c9c8a7 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:16.168605 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534ce2a-70ce-4282-b310-366ea8c9c8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:16.168913 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534ce2a-70ce-4282-b310-366ea8c9c8a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:16.169684 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534ce2a-70ce-4282-b310-366ea8c9c8a7 None admin] RBAC: Adding query filter params (group.id=519cc8d7a5624287873ae043faef85ad, role.id=7f4b8cdb739c4f808ef31961eb11510e, scope.project.id=3883b1b257924533a84cbc24a92ea6e1) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:16.169997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534ce2a-70ce-4282-b310-366ea8c9c8a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:16.171474 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534ce2a-70ce-4282-b310-366ea8c9c8a7 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:16.177826 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 214/442] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Aug 22 20:26:16 2022] GET /identity/v3/role_assignments?group.id=519cc8d7a5624287873ae043faef85ad&scope.project.id=3883b1b257924533a84cbc24a92ea6e1&role.id=7f4b8cdb739c4f808ef31961eb11510e => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:16.178811 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534ce2a-70ce-4282-b310-366ea8c9c8a7 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:16.260366 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4cd0a4-8ef4-4196-a414-f86865686270 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:16.288575 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:16.307712 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ccf656-7c6a-421e-80d1-088f7767cad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:16.308400 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ccf656-7c6a-421e-80d1-088f7767cad2 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:16.308702 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ccf656-7c6a-421e-80d1-088f7767cad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:16.308945 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534ce2a-70ce-4282-b310-366ea8c9c8a7 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:16.309045 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ccf656-7c6a-421e-80d1-088f7767cad2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:16.331198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ccf656-7c6a-421e-80d1-088f7767cad2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:16.336398 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-28ccf656-7c6a-421e-80d1-088f7767cad2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:26:16.336398 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:16.336398 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:16.336398 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:16.336398 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:16.336398 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:16.336398 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:16.336398 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:16.336398 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:16.336398 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:16.336398 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:16.336398 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:16.336398 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:16.336398 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:16.336398 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:16.336398 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:16.337518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:16.337518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:16.337518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:16.337518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:16.337518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:16.337518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:16.337518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:16.337518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:16.337518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:16.337518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:16.337518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:16.337518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:16.337518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:16.337518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:16.337518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:16.337518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:16.339881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:16.339881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:16.339881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:16.339881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:16.339881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:16.339881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:16.339881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:16.339881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:16.339881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:16.339881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:16.339881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:26:16.339881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:16.339881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 229/443] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 22 20:26:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:16.339881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ccf656-7c6a-421e-80d1-088f7767cad2 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:16.353650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb4923-8ac2-4a62-96b9-d60318b0c6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:16.354262 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb4923-8ac2-4a62-96b9-d60318b0c6e7 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:16.354538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb4923-8ac2-4a62-96b9-d60318b0c6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:16.354853 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb4923-8ac2-4a62-96b9-d60318b0c6e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:16.355585 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb4923-8ac2-4a62-96b9-d60318b0c6e7 None admin] RBAC: Adding query filter params (group.id=519cc8d7a5624287873ae043faef85ad, role.id=028945f544094c26933c8ef60a480e9a, scope.project.id=d0af86473fde40a2b26933e4ecd0901a) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:16.355934 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb4923-8ac2-4a62-96b9-d60318b0c6e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:16.357416 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb4923-8ac2-4a62-96b9-d60318b0c6e7 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:16.366730 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 215/444] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Aug 22 20:26:16 2022] GET /identity/v3/role_assignments?group.id=519cc8d7a5624287873ae043faef85ad&scope.project.id=d0af86473fde40a2b26933e4ecd0901a&role.id=028945f544094c26933c8ef60a480e9a => generated 611 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:16.368124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb4923-8ac2-4a62-96b9-d60318b0c6e7 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:16.456839 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:16.494192 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ccf656-7c6a-421e-80d1-088f7767cad2 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:16.512732 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb4923-8ac2-4a62-96b9-d60318b0c6e7 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:16.540611 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b1388-e90b-43ae-a535-2b763db4d526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:16.541282 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b1388-e90b-43ae-a535-2b763db4d526 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:16.541572 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b1388-e90b-43ae-a535-2b763db4d526 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:16.541834 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b1388-e90b-43ae-a535-2b763db4d526 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:16.555921 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b1388-e90b-43ae-a535-2b763db4d526 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:16.557833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd57c9-47c7-454a-b484-5cc951278a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:16.558450 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd57c9-47c7-454a-b484-5cc951278a2d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:16.558733 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd57c9-47c7-454a-b484-5cc951278a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:16.559007 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd57c9-47c7-454a-b484-5cc951278a2d None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:16.559674 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd57c9-47c7-454a-b484-5cc951278a2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:16.559976 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd57c9-47c7-454a-b484-5cc951278a2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:16.560793 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-591b1388-e90b-43ae-a535-2b763db4d526 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:26:16.560793 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:16.560793 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:16.560793 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:16.560793 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:16.560793 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:16.560793 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:16.560793 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:16.560793 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:16.560793 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:16.560793 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:16.560793 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:16.560793 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:16.560793 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:16.560793 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:16.560793 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:16.561642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:16.561642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:16.561642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:16.561642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:16.561642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:16.561642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:16.561642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:16.561642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:16.561642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:16.561642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:16.561642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:16.561642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:16.561642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:16.561642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:16.561642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:16.561642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:16.562420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:16.562420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:16.562420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:16.562420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:16.562420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:16.562420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:16.562420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:16.562420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:16.562420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:16.562420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:16.562420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:26:16.562420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:16.563004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd57c9-47c7-454a-b484-5cc951278a2d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:16.563079 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 230/445] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 22 20:26:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:16.570260 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b1388-e90b-43ae-a535-2b763db4d526 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:16.572862 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 216/446] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:26:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:16.578538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd57c9-47c7-454a-b484-5cc951278a2d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:16.598612 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:16.683582 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b1388-e90b-43ae-a535-2b763db4d526 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:16.703597 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd57c9-47c7-454a-b484-5cc951278a2d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:16.722297 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0210027-9f17-463c-a1fc-8445762301bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:16.725049 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0210027-9f17-463c-a1fc-8445762301bf None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:16.725049 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0210027-9f17-463c-a1fc-8445762301bf None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:16.725049 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0210027-9f17-463c-a1fc-8445762301bf None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:16.725442 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0210027-9f17-463c-a1fc-8445762301bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:16.725909 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0210027-9f17-463c-a1fc-8445762301bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:16.727388 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0210027-9f17-463c-a1fc-8445762301bf None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:16.730468 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:16.737524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 231/447] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:26:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:16.750509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0210027-9f17-463c-a1fc-8445762301bf None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:16.750629 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc768b-981d-4306-8752-168a3aca46b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:16.750629 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc768b-981d-4306-8752-168a3aca46b7 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:16.750629 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc768b-981d-4306-8752-168a3aca46b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:16.750629 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc768b-981d-4306-8752-168a3aca46b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:16.831590 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc768b-981d-4306-8752-168a3aca46b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:16.833146 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc768b-981d-4306-8752-168a3aca46b7 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:16.847526 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:16.859535 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0210027-9f17-463c-a1fc-8445762301bf None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:16.892537 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfdd62-9b25-43a7-aa8d-6337787bc3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:16.893158 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfdd62-9b25-43a7-aa8d-6337787bc3d0 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:16.893430 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfdd62-9b25-43a7-aa8d-6337787bc3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:16.893704 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfdd62-9b25-43a7-aa8d-6337787bc3d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:16.932619 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 217/448] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:26:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 20:26:16.938529 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc768b-981d-4306-8752-168a3aca46b7 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:16.959133 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:16.963046 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbfdd62-9b25-43a7-aa8d-6337787bc3d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:16.964537 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbfdd62-9b25-43a7-aa8d-6337787bc3d0 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:17.037469 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc768b-981d-4306-8752-168a3aca46b7 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:17.057112 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:17.065809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 232/449] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:26:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 20:26:17.071997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfdd62-9b25-43a7-aa8d-6337787bc3d0 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:17.080142 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3308b-fafa-4266-b20a-2b787beb4acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:17.080817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3308b-fafa-4266-b20a-2b787beb4acf None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:17.081093 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3308b-fafa-4266-b20a-2b787beb4acf None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:17.081363 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3308b-fafa-4266-b20a-2b787beb4acf None admin] PATH_INFO: `/v3/projects/7adb0f361d1a498f9e39b33b2bbe63ec` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:17.082484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3308b-fafa-4266-b20a-2b787beb4acf None admin] RBAC: Authorizing `identity:get_project(project_id=7adb0f361d1a498f9e39b33b2bbe63ec)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:17.084683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3308b-fafa-4266-b20a-2b787beb4acf None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:17.086950 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 218/450] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:26:16 2022] GET /identity/v3/projects/7adb0f361d1a498f9e39b33b2bbe63ec => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:26:17.092164 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3308b-fafa-4266-b20a-2b787beb4acf None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:17.169214 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:17.172873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfdd62-9b25-43a7-aa8d-6337787bc3d0 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:17.190750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3308b-fafa-4266-b20a-2b787beb4acf None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:17.207423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e9fe2-6f6f-4390-9038-f5d0b23481e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:17.208040 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e9fe2-6f6f-4390-9038-f5d0b23481e7 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:17.208314 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e9fe2-6f6f-4390-9038-f5d0b23481e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:17.209270 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e9fe2-6f6f-4390-9038-f5d0b23481e7 None admin] PATH_INFO: `/v3/projects/d0af86473fde40a2b26933e4ecd0901a` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:17.210429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e9fe2-6f6f-4390-9038-f5d0b23481e7 None admin] RBAC: Authorizing `identity:get_project(project_id=d0af86473fde40a2b26933e4ecd0901a)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:17.211862 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e9fe2-6f6f-4390-9038-f5d0b23481e7 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:17.213487 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 233/451] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:26:17 2022] GET /identity/v3/projects/d0af86473fde40a2b26933e4ecd0901a => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:26:17.218918 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e9fe2-6f6f-4390-9038-f5d0b23481e7 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:17.227523 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6d57a-a07b-4d63-972b-9b2ed4e46dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:17.228151 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6d57a-a07b-4d63-972b-9b2ed4e46dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:17.228430 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6d57a-a07b-4d63-972b-9b2ed4e46dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:17.228731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6d57a-a07b-4d63-972b-9b2ed4e46dd5 None admin] PATH_INFO: `/v3/groups/066edefba0914ffa8cd1c71ecf798a0e` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:17.229923 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6d57a-a07b-4d63-972b-9b2ed4e46dd5 None admin] RBAC: Authorizing `identity:get_group(group_id=066edefba0914ffa8cd1c71ecf798a0e)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:17.231359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6d57a-a07b-4d63-972b-9b2ed4e46dd5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:17.232937 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 219/452] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Aug 22 20:26:17 2022] GET /identity/v3/groups/066edefba0914ffa8cd1c71ecf798a0e => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:26:17.238462 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6d57a-a07b-4d63-972b-9b2ed4e46dd5 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:17.287559 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:17.316111 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e9fe2-6f6f-4390-9038-f5d0b23481e7 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:17.337598 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6d57a-a07b-4d63-972b-9b2ed4e46dd5 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:17.351056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa351e87-0c97-4355-8193-c727b5ee6326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:17.351683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa351e87-0c97-4355-8193-c727b5ee6326 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:17.351964 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa351e87-0c97-4355-8193-c727b5ee6326 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:17.352238 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa351e87-0c97-4355-8193-c727b5ee6326 None admin] PATH_INFO: `/v3/groups/519cc8d7a5624287873ae043faef85ad` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:17.353378 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa351e87-0c97-4355-8193-c727b5ee6326 None admin] RBAC: Authorizing `identity:get_group(group_id=519cc8d7a5624287873ae043faef85ad)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:17.354807 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa351e87-0c97-4355-8193-c727b5ee6326 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:17.356354 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 234/453] 10.222.0.62 () {56 vars in 1180 bytes} [Mon Aug 22 20:26:17 2022] GET /identity/v3/groups/519cc8d7a5624287873ae043faef85ad => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:26:17.362184 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa351e87-0c97-4355-8193-c727b5ee6326 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:17.374066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa6e70-7204-4393-9b6e-9414047c4342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:17.374675 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa6e70-7204-4393-9b6e-9414047c4342 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:17.374964 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa6e70-7204-4393-9b6e-9414047c4342 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:17.375237 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa6e70-7204-4393-9b6e-9414047c4342 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:17.375957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa6e70-7204-4393-9b6e-9414047c4342 None admin] RBAC: Adding query filter params (group.id=066edefba0914ffa8cd1c71ecf798a0e, role.id=e3faa0474c054da6bb4d8910a4e40bff, scope.project.id=7adb0f361d1a498f9e39b33b2bbe63ec) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:17.376263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa6e70-7204-4393-9b6e-9414047c4342 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:17.377727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa6e70-7204-4393-9b6e-9414047c4342 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:17.384241 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 220/454] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Aug 22 20:26:17 2022] GET /identity/v3/role_assignments?group.id=066edefba0914ffa8cd1c71ecf798a0e&scope.project.id=7adb0f361d1a498f9e39b33b2bbe63ec&role.id=e3faa0474c054da6bb4d8910a4e40bff => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:26:17.398174 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:17.468887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa351e87-0c97-4355-8193-c727b5ee6326 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:17.503899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fac3b9-f60f-403a-a088-acf8f2fdc2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:17.504507 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fac3b9-f60f-403a-a088-acf8f2fdc2a9 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:17.504820 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fac3b9-f60f-403a-a088-acf8f2fdc2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:17.505089 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fac3b9-f60f-403a-a088-acf8f2fdc2a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:17.505867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fac3b9-f60f-403a-a088-acf8f2fdc2a9 None admin] RBAC: Adding query filter params (group.id=519cc8d7a5624287873ae043faef85ad, role.id=7f4b8cdb739c4f808ef31961eb11510e, scope.project.id=d0af86473fde40a2b26933e4ecd0901a) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:17.506164 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fac3b9-f60f-403a-a088-acf8f2fdc2a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:17.507613 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fac3b9-f60f-403a-a088-acf8f2fdc2a9 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:17.513972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 235/455] 10.222.0.62 () {56 vars in 1376 bytes} [Mon Aug 22 20:26:17 2022] GET /identity/v3/role_assignments?group.id=519cc8d7a5624287873ae043faef85ad&scope.project.id=d0af86473fde40a2b26933e4ecd0901a&role.id=7f4b8cdb739c4f808ef31961eb11510e => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:26:19.957694 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f8406-9922-4cc0-aeeb-141d2c0a8335 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:19.959145 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f8406-9922-4cc0-aeeb-141d2c0a8335 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:19.959634 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f8406-9922-4cc0-aeeb-141d2c0a8335 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:19.961425 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 221/456] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:19.967090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ced86-ebe1-401c-a428-042b3293497d None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:19.967921 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ced86-ebe1-401c-a428-042b3293497d None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:19.968382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ced86-ebe1-401c-a428-042b3293497d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:19.992055 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-957ced86-ebe1-401c-a428-042b3293497d None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:19.993607 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-957ced86-ebe1-401c-a428-042b3293497d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:20.091231 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 236/457] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:26:20.192148 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555135ce-5bbd-4eea-a661-995f1b7eba00 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:20.192489 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555135ce-5bbd-4eea-a661-995f1b7eba00 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:20.192781 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555135ce-5bbd-4eea-a661-995f1b7eba00 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:20.194454 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 222/458] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:20.199821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9d77e-aef9-4749-bf84-4b70a421d3f1 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:20.200337 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9d77e-aef9-4749-bf84-4b70a421d3f1 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:20.200841 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9d77e-aef9-4749-bf84-4b70a421d3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:20.224729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-1ab9d77e-aef9-4749-bf84-4b70a421d3f1 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:20.226432 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-1ab9d77e-aef9-4749-bf84-4b70a421d3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:20.227416 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c52b7-ecf0-4274-a51a-d035528e0fc4 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:20.227709 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c52b7-ecf0-4274-a51a-d035528e0fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:20.227981 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c52b7-ecf0-4274-a51a-d035528e0fc4 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:20.229456 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 223/459] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:20.234243 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7dab5-4288-497d-9c40-70bbcf7e49a0 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:20.234531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7dab5-4288-497d-9c40-70bbcf7e49a0 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:20.234804 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7dab5-4288-497d-9c40-70bbcf7e49a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:20.255643 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-78a7dab5-4288-497d-9c40-70bbcf7e49a0 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:20.257344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-78a7dab5-4288-497d-9c40-70bbcf7e49a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:20.269280 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:20.338976 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 224/460] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:26:20.370990 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 237/461] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:20.423074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7dab5-4288-497d-9c40-70bbcf7e49a0 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:20.479427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:20.549202 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7dab5-4288-497d-9c40-70bbcf7e49a0 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:20.600188 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4ed74-ca3e-46ef-a69d-d7f809db53f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:20.600897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4ed74-ca3e-46ef-a69d-d7f809db53f4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:20.601178 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4ed74-ca3e-46ef-a69d-d7f809db53f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:20.601450 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4ed74-ca3e-46ef-a69d-d7f809db53f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:20.612479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb4ed74-ca3e-46ef-a69d-d7f809db53f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:20.614016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb4ed74-ca3e-46ef-a69d-d7f809db53f4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:20.636696 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-8fb4ed74-ca3e-46ef-a69d-d7f809db53f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:20.636696 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:20.636696 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:20.636696 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:20.636696 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:20.636696 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:20.636696 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:20.636696 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:20.636696 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:20.636696 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:20.636696 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:20.636696 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:20.636696 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:20.636696 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:20.636696 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:20.636696 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:20.637650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:20.637650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:20.637650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:20.637650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:20.637650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:20.637650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:20.637650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:20.637650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:20.637650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:20.637650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:20.637650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:20.637650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:20.637650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:20.637650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:20.637650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:20.637650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:20.637650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:20.638485 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:20.638485 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:20.638485 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:20.638485 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 225/462] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:20.645794 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9d77e-aef9-4749-bf84-4b70a421d3f1 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:20.668531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4ed74-ca3e-46ef-a69d-d7f809db53f4 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:20.778293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9d77e-aef9-4749-bf84-4b70a421d3f1 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:20.793501 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:20.798371 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4ed74-ca3e-46ef-a69d-d7f809db53f4 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:20.817015 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0032cf4-61e9-45dd-ac3c-338a3b50aa44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:20.818363 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0032cf4-61e9-45dd-ac3c-338a3b50aa44 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:20.818646 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0032cf4-61e9-45dd-ac3c-338a3b50aa44 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:20.818969 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0032cf4-61e9-45dd-ac3c-338a3b50aa44 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:20.819670 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0032cf4-61e9-45dd-ac3c-338a3b50aa44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:20.819976 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0032cf4-61e9-45dd-ac3c-338a3b50aa44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:20.821389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0032cf4-61e9-45dd-ac3c-338a3b50aa44 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:20.835239 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 238/463] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:20.836129 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0032cf4-61e9-45dd-ac3c-338a3b50aa44 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:20.858084 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91047ce5-02a1-4ef3-8044-fbb8e8a29101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:20.858976 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91047ce5-02a1-4ef3-8044-fbb8e8a29101 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:20.859258 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91047ce5-02a1-4ef3-8044-fbb8e8a29101 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:20.859924 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:20.861004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91047ce5-02a1-4ef3-8044-fbb8e8a29101 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:20.873513 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91047ce5-02a1-4ef3-8044-fbb8e8a29101 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:20.875355 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91047ce5-02a1-4ef3-8044-fbb8e8a29101 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:20.892790 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-91047ce5-02a1-4ef3-8044-fbb8e8a29101 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:20.892790 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:20.892790 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:20.892790 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:20.892790 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:20.892790 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:20.892790 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:20.892790 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:20.892790 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:20.892790 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:20.892790 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:20.892790 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:20.892790 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:20.892790 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:20.892790 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:20.892790 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:20.893938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:20.893938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:20.893938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:20.893938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:20.893938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:20.893938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:20.893938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:20.893938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:20.893938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:20.893938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:20.893938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:20.893938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:20.893938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:20.893938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:20.893938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:20.893938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:20.893938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:20.894933 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:20.894933 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:20.894933 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:20.901962 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 226/464] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:26:20.903149 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91047ce5-02a1-4ef3-8044-fbb8e8a29101 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:20.950031 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0032cf4-61e9-45dd-ac3c-338a3b50aa44 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:20.987485 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f8084-8894-4f69-b630-4ae3ebbf4b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:20.988119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f8084-8894-4f69-b630-4ae3ebbf4b06 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:20.989078 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f8084-8894-4f69-b630-4ae3ebbf4b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:20.989078 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f8084-8894-4f69-b630-4ae3ebbf4b06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:21.000161 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f8084-8894-4f69-b630-4ae3ebbf4b06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:21.001845 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f8084-8894-4f69-b630-4ae3ebbf4b06 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:21.017642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-113f8084-8894-4f69-b630-4ae3ebbf4b06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:21.017642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:21.017642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:21.017642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:21.017642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:21.017642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:21.017642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:21.017642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:21.017642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:21.017642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:21.017642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:21.017642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:21.017642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:21.017642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:21.017642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:21.017642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:21.018795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:21.018795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:21.018795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:21.018795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:21.018795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:21.018795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:21.018795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:21.018795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:21.018795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:21.018795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:21.018795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:21.018795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:21.018795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:21.018795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:21.018795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:21.018795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:21.018795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:21.019859 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:21.019859 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:21.019859 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:21.020972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 239/465] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:21.021978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f8084-8894-4f69-b630-4ae3ebbf4b06 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:21.027093 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91047ce5-02a1-4ef3-8044-fbb8e8a29101 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:21.066218 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cf5b2-b6f1-4199-8143-102f1bd3f170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:21.067167 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cf5b2-b6f1-4199-8143-102f1bd3f170 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:21.068162 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cf5b2-b6f1-4199-8143-102f1bd3f170 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:21.068646 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cf5b2-b6f1-4199-8143-102f1bd3f170 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:21.069595 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4cf5b2-b6f1-4199-8143-102f1bd3f170 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:21.071229 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4cf5b2-b6f1-4199-8143-102f1bd3f170 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:21.097833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:21.133031 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f8084-8894-4f69-b630-4ae3ebbf4b06 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:21.183311 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f1e0f1-ca62-4b59-9966-4c6cb006e44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:21.183844 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1e0f1-ca62-4b59-9966-4c6cb006e44c None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:21.184117 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1e0f1-ca62-4b59-9966-4c6cb006e44c None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:21.184399 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f1e0f1-ca62-4b59-9966-4c6cb006e44c None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:21.185099 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f1e0f1-ca62-4b59-9966-4c6cb006e44c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:21.185400 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f1e0f1-ca62-4b59-9966-4c6cb006e44c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:21.186772 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f1e0f1-ca62-4b59-9966-4c6cb006e44c None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:21.189065 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 227/466] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Aug 22 20:26:20 2022] POST /identity/v3/users => generated 246 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:26:21.196379 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cf5b2-b6f1-4199-8143-102f1bd3f170 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:21.202751 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:21.203963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 240/467] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:21.205286 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c929972-27b1-40a1-9971-ced6bcb489d2 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:21.205578 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c929972-27b1-40a1-9971-ced6bcb489d2 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:21.205901 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c929972-27b1-40a1-9971-ced6bcb489d2 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:21.208723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 241/468] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:21.213414 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed120dd-e7a1-463e-b41c-720ea3518727 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:21.213892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed120dd-e7a1-463e-b41c-720ea3518727 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:21.214333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed120dd-e7a1-463e-b41c-720ea3518727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:21.235654 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-2ed120dd-e7a1-463e-b41c-720ea3518727 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:21.237282 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-2ed120dd-e7a1-463e-b41c-720ea3518727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:21.314442 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 242/469] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:21.315721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed120dd-e7a1-463e-b41c-720ea3518727 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:21.347481 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cf5b2-b6f1-4199-8143-102f1bd3f170 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:21.388465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921e827-48a3-40ab-a8bc-21e01c19a1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:21.389156 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921e827-48a3-40ab-a8bc-21e01c19a1e5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:21.389437 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921e827-48a3-40ab-a8bc-21e01c19a1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:21.389708 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921e827-48a3-40ab-a8bc-21e01c19a1e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:21.390791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9921e827-48a3-40ab-a8bc-21e01c19a1e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:21.391106 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9921e827-48a3-40ab-a8bc-21e01c19a1e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:21.392494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9921e827-48a3-40ab-a8bc-21e01c19a1e5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:21.408081 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 228/470] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:21.414405 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921e827-48a3-40ab-a8bc-21e01c19a1e5 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:21.417727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:21.469710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed120dd-e7a1-463e-b41c-720ea3518727 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:21.483028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:21.511645 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0f0a4-e175-442f-9277-12b6a49e173f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:21.512559 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0f0a4-e175-442f-9277-12b6a49e173f None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:21.513004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0f0a4-e175-442f-9277-12b6a49e173f None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:21.513436 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0f0a4-e175-442f-9277-12b6a49e173f None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:21.514275 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0f0a4-e175-442f-9277-12b6a49e173f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:21.516230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b0f0a4-e175-442f-9277-12b6a49e173f None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:21.529139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921e827-48a3-40ab-a8bc-21e01c19a1e5 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:21.567291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe7e97-afd5-4c2a-8a00-a07002ac6227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:21.567921 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe7e97-afd5-4c2a-8a00-a07002ac6227 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:21.568197 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe7e97-afd5-4c2a-8a00-a07002ac6227 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:21.568464 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe7e97-afd5-4c2a-8a00-a07002ac6227 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:21.569153 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe7e97-afd5-4c2a-8a00-a07002ac6227 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:21.570605 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbe7e97-afd5-4c2a-8a00-a07002ac6227 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:21.612235 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 243/471] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Aug 22 20:26:21 2022] POST /identity/v3/users => generated 248 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:26:21.613524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f55d5-3e5f-4e23-b1e5-3174aae1867d None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:21.613808 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f55d5-3e5f-4e23-b1e5-3174aae1867d None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:21.614077 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f55d5-3e5f-4e23-b1e5-3174aae1867d None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:21.616141 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 244/472] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:21.622137 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de56f1-3881-4216-896a-28c8436433d7 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:21.622458 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de56f1-3881-4216-896a-28c8436433d7 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:21.622683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de56f1-3881-4216-896a-28c8436433d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:21.642804 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-16de56f1-3881-4216-896a-28c8436433d7 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:21.644095 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-16de56f1-3881-4216-896a-28c8436433d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:21.694591 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 229/473] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Aug 22 20:26:21 2022] POST /identity/v3/users => generated 248 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:26:21.695467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe7e97-afd5-4c2a-8a00-a07002ac6227 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:21.747608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 245/474] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:26:21.867082 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe7e97-afd5-4c2a-8a00-a07002ac6227 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:21.889220 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:21.907622 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0180e-6c45-4c45-80ca-7e9be5e677d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:21.908926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0180e-6c45-4c45-80ca-7e9be5e677d4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:21.908926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0180e-6c45-4c45-80ca-7e9be5e677d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:21.908926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0180e-6c45-4c45-80ca-7e9be5e677d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:21.920815 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad0180e-6c45-4c45-80ca-7e9be5e677d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:21.922288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad0180e-6c45-4c45-80ca-7e9be5e677d4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:21.939299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-1ad0180e-6c45-4c45-80ca-7e9be5e677d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:21.939299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:21.939299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:21.939299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:21.939299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:21.939299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:21.939299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:21.939299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:21.939299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:21.939299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:21.939299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:21.939299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:21.939299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:21.939299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:21.939299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:21.939299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:21.940209 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:21.940209 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:21.940209 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:21.940209 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:21.940209 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:21.940209 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:21.940209 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:21.940209 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:21.940209 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:21.940209 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:21.940209 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:21.940209 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:21.940209 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:21.940209 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:21.940209 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:21.940209 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:21.940209 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:21.941869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:21.941869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:21.941869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:21.941869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 230/475] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:21.947365 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de56f1-3881-4216-896a-28c8436433d7 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:21.998087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:22.060695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de56f1-3881-4216-896a-28c8436433d7 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:22.069211 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0180e-6c45-4c45-80ca-7e9be5e677d4 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:22.104037 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bdbb92-af04-40cb-bae0-b87c3d224023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:22.104650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdbb92-af04-40cb-bae0-b87c3d224023 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:22.104944 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdbb92-af04-40cb-bae0-b87c3d224023 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:22.105217 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdbb92-af04-40cb-bae0-b87c3d224023 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:22.105862 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bdbb92-af04-40cb-bae0-b87c3d224023 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:22.106173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bdbb92-af04-40cb-bae0-b87c3d224023 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:22.107671 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bdbb92-af04-40cb-bae0-b87c3d224023 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:22.120473 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 246/476] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:22.126681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bdbb92-af04-40cb-bae0-b87c3d224023 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:22.214737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0180e-6c45-4c45-80ca-7e9be5e677d4 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:22.268556 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4909def-1092-428e-97fb-94167d58facd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:22.269108 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4909def-1092-428e-97fb-94167d58facd None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:22.269385 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4909def-1092-428e-97fb-94167d58facd None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:22.269655 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4909def-1092-428e-97fb-94167d58facd None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:22.270317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4909def-1092-428e-97fb-94167d58facd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:22.272311 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4909def-1092-428e-97fb-94167d58facd None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:22.305542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bdbb92-af04-40cb-bae0-b87c3d224023 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:22.313983 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.sql.core [None req-e4909def-1092-428e-97fb-94167d58facd None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 22 20:26:22.313983 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 22 20:26:22.313983 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [parameters: {'id': '89e73deb487b48d6b49aeaf8a84b3b89', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 22 20:26:22.313983 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81638) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 22 20:26:22.328784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:22.341492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-e4909def-1092-428e-97fb-94167d58facd None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 22 20:26:22.341492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:22.341492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 20:26:22.341492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 20:26:22.341492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 20:26:22.341492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 20:26:22.341492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 20:26:22.341492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 20:26:22.341492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 20:26:22.341492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application conn.query(q) Aug 22 20:26:22.341492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 20:26:22.341492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 20:26:22.341492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 20:26:22.341492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application result.read() Aug 22 20:26:22.341492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 20:26:22.346518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 20:26:22.346518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 20:26:22.346518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 20:26:22.346518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 20:26:22.346518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 20:26:22.346518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 20:26:22.346518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 20:26:22.346518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 22 20:26:22.346518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:22.346518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 22 20:26:22.346518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:22.346518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:22.346518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 22 20:26:22.346518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 22 20:26:22.346518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 22 20:26:22.346518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return ref.to_dict() Aug 22 20:26:22.346518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 20:26:22.346518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application next(self.gen) Aug 22 20:26:22.347414 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 22 20:26:22.347414 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application yield resource Aug 22 20:26:22.347414 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 20:26:22.347414 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application next(self.gen) Aug 22 20:26:22.347414 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 22 20:26:22.347414 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self.session.rollback() Aug 22 20:26:22.347414 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 20:26:22.347414 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self.force_reraise() Aug 22 20:26:22.347414 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 20:26:22.347414 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise self.value Aug 22 20:26:22.347414 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 22 20:26:22.347414 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 22 20:26:22.347414 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 22 20:26:22.347414 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application session.commit() Aug 22 20:26:22.347414 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 22 20:26:22.347414 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 22 20:26:22.347414 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 22 20:26:22.348278 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._prepare_impl() Aug 22 20:26:22.348278 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 22 20:26:22.348278 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self.session.flush() Aug 22 20:26:22.348278 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 22 20:26:22.348278 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._flush(objects) Aug 22 20:26:22.348278 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 22 20:26:22.348278 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 22 20:26:22.348278 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 22 20:26:22.348278 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application compat.raise_( Aug 22 20:26:22.348278 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 20:26:22.348278 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception Aug 22 20:26:22.348278 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 22 20:26:22.348278 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application flush_context.execute() Aug 22 20:26:22.348278 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 22 20:26:22.348278 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rec.execute(self) Aug 22 20:26:22.348278 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 22 20:26:22.348278 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 22 20:26:22.349215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 22 20:26:22.349215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 22 20:26:22.349215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 22 20:26:22.349215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 22 20:26:22.349215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 22 20:26:22.349215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 22 20:26:22.349215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 22 20:26:22.349215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 22 20:26:22.349215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 22 20:26:22.349215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 22 20:26:22.349215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 22 20:26:22.349215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 22 20:26:22.349215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 22 20:26:22.349215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 22 20:26:22.349215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 20:26:22.349215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception Aug 22 20:26:22.350204 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 20:26:22.350204 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 20:26:22.350204 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 20:26:22.350204 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 20:26:22.350204 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 20:26:22.350204 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 20:26:22.350204 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 20:26:22.350204 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application conn.query(q) Aug 22 20:26:22.350204 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 20:26:22.350204 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 20:26:22.350204 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 20:26:22.350204 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application result.read() Aug 22 20:26:22.350204 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 20:26:22.350204 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 20:26:22.350204 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 20:26:22.350204 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 20:26:22.351087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 20:26:22.351087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 20:26:22.351087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 20:26:22.351087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 20:26:22.351087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 22 20:26:22.351087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 22 20:26:22.351087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [parameters: {'id': '89e73deb487b48d6b49aeaf8a84b3b89', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 22 20:26:22.351087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 22 20:26:22.351087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:22.351087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:26:22.351087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:22.351087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:22.351087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:22.351087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:22.351087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:22.351087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:22.351948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:22.351948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:22.351948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:22.351948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:22.351948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:22.351948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:22.351948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 22 20:26:22.351948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 22 20:26:22.351948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:22.351948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:22.351948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 22 20:26:22.351948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 22 20:26:22.351948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 22 20:26:22.351948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 22 20:26:22.351948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 22 20:26:22.351948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:22.352766 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 231/477] 10.222.0.62 () {60 vars in 1131 bytes} [Mon Aug 22 20:26:22 2022] POST /identity/v3/roles => generated 144 bytes in 277 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:26:22.356360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4909def-1092-428e-97fb-94167d58facd None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:22.379567 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6983262a-ef23-4998-8128-b44a64d640a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:22.380903 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983262a-ef23-4998-8128-b44a64d640a6 None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:22.381274 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983262a-ef23-4998-8128-b44a64d640a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:22.381554 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983262a-ef23-4998-8128-b44a64d640a6 None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:22.382212 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6983262a-ef23-4998-8128-b44a64d640a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:22.383706 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6983262a-ef23-4998-8128-b44a64d640a6 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:22.401374 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:22.476507 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4909def-1092-428e-97fb-94167d58facd None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:22.497060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 247/478] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Aug 22 20:26:22 2022] POST /identity/v3/users => generated 249 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:26:22.527816 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6308f94-682b-4d0f-bfdc-8d46218938c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:22.527816 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6308f94-682b-4d0f-bfdc-8d46218938c6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:22.527816 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6308f94-682b-4d0f-bfdc-8d46218938c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:22.527816 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6308f94-682b-4d0f-bfdc-8d46218938c6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:22.535932 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6308f94-682b-4d0f-bfdc-8d46218938c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:22.541122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-f6308f94-682b-4d0f-bfdc-8d46218938c6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:26:22.541122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:22.541122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:22.541122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:22.541122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:22.541122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:22.541122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:22.541122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:22.541122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:22.541122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:22.541122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:22.541122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:22.541122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:22.541122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:22.541122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:22.541122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:22.543016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:22.543016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:22.543016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:22.543016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:22.543016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:22.543016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:22.543016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:22.543016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:22.543016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:22.543016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:22.543016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:22.543016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:22.543016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:22.543016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:22.543016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:22.543016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:22.543993 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:22.543993 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:22.543993 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:22.543993 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:22.543993 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:22.543993 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:22.543993 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:22.543993 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:22.543993 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:22.543993 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:22.543993 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 20:26:22.543993 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:22.543993 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 232/479] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 22 20:26:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:26:22.551022 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6983262a-ef23-4998-8128-b44a64d640a6 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:22.723017 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6983262a-ef23-4998-8128-b44a64d640a6 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:22.767092 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8df6b-4521-4f08-9c97-c3a82edc2285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:22.767964 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8df6b-4521-4f08-9c97-c3a82edc2285 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:22.768389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8df6b-4521-4f08-9c97-c3a82edc2285 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:22.768884 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8df6b-4521-4f08-9c97-c3a82edc2285 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:22.769689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8df6b-4521-4f08-9c97-c3a82edc2285 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:22.771807 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8df6b-4521-4f08-9c97-c3a82edc2285 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:22.773381 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8df6b-4521-4f08-9c97-c3a82edc2285 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:22.787969 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 248/480] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:26:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:23.590415 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521803c1-4d1a-44d2-bfa2-b75b4d9fe224 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:23.591266 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521803c1-4d1a-44d2-bfa2-b75b4d9fe224 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:23.591542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521803c1-4d1a-44d2-bfa2-b75b4d9fe224 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:23.593070 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 233/481] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:23.598216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ed3c0-5be2-47c9-9ca2-d7ff821c5740 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:23.599291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ed3c0-5be2-47c9-9ca2-d7ff821c5740 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:23.599373 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ed3c0-5be2-47c9-9ca2-d7ff821c5740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:23.621631 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-0c8ed3c0-5be2-47c9-9ca2-d7ff821c5740 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:23.622820 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-0c8ed3c0-5be2-47c9-9ca2-d7ff821c5740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:23.645337 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:23.709919 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 249/482] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:24.031989 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521803c1-4d1a-44d2-bfa2-b75b4d9fe224 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:24.162894 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:24.171365 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521803c1-4d1a-44d2-bfa2-b75b4d9fe224 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:24.184261 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e2dde-4aee-47a3-bc1e-bb5af07332c7 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:24.185372 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e2dde-4aee-47a3-bc1e-bb5af07332c7 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:24.185856 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e2dde-4aee-47a3-bc1e-bb5af07332c7 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:24.187967 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 250/483] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:26:24.193866 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdb955-9ce5-4fed-b208-283f7bcd46f0 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:24.194148 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdb955-9ce5-4fed-b208-283f7bcd46f0 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:24.194425 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfdb955-9ce5-4fed-b208-283f7bcd46f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:24.221470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb51c19-87b8-440e-8dd1-4cfb6e112993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:24.222103 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb51c19-87b8-440e-8dd1-4cfb6e112993 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:24.222435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb51c19-87b8-440e-8dd1-4cfb6e112993 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:24.222710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb51c19-87b8-440e-8dd1-4cfb6e112993 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:24.230187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-abfdb955-9ce5-4fed-b208-283f7bcd46f0 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:24.231397 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-abfdb955-9ce5-4fed-b208-283f7bcd46f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:24.234570 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb51c19-87b8-440e-8dd1-4cfb6e112993 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:24.239465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-9bb51c19-87b8-440e-8dd1-4cfb6e112993 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:26:24.239465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:24.239465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:24.239465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:24.239465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:24.239465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:24.239465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:24.239465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:24.239465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:24.239465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:24.239465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:24.239465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:24.239465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:24.239465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:24.239465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:24.239465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:24.240455 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:24.240455 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:24.240455 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:24.240455 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:24.240455 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:24.240455 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:24.240455 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:24.240455 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:24.240455 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:24.240455 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:24.240455 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:24.240455 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:24.240455 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:24.240455 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:24.240455 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:24.240455 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:24.245263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:24.245263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:24.245263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:24.245263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:24.245263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:24.245263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:24.245263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:24.245263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:24.245263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:24.245263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:24.245263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:26:24.245263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:24.245263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 234/484] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 22 20:26:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:24.245263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1284822-5285-42e6-ab9e-97e70e065997 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:24.245996 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1284822-5285-42e6-ab9e-97e70e065997 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:24.245996 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1284822-5285-42e6-ab9e-97e70e065997 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:24.245996 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 235/485] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:24.249154 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1284822-5285-42e6-ab9e-97e70e065997 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:24.323803 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 251/486] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:24.325187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6407d-b28e-4678-9380-e3878bdf3ea4 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:24.325471 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6407d-b28e-4678-9380-e3878bdf3ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:24.325911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6407d-b28e-4678-9380-e3878bdf3ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:24.346957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-25b6407d-b28e-4678-9380-e3878bdf3ea4 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:24.348672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-25b6407d-b28e-4678-9380-e3878bdf3ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:24.380453 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1284822-5285-42e6-ab9e-97e70e065997 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:24.414792 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f94e6-4e6b-447a-b902-5ea768e95a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:24.414792 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f94e6-4e6b-447a-b902-5ea768e95a35 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:24.414792 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f94e6-4e6b-447a-b902-5ea768e95a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:24.414792 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f94e6-4e6b-447a-b902-5ea768e95a35 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:24.415427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f94e6-4e6b-447a-b902-5ea768e95a35 None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:24.415427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f94e6-4e6b-447a-b902-5ea768e95a35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:24.415427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f94e6-4e6b-447a-b902-5ea768e95a35 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:24.424704 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 236/487] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 22 20:26:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:24.430888 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f94e6-4e6b-447a-b902-5ea768e95a35 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:24.471711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:24.485775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 252/488] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:24.632728 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f94e6-4e6b-447a-b902-5ea768e95a35 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:24.706265 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78dea38-de53-4263-a44e-9f0d0481a24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:24.706909 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dea38-de53-4263-a44e-9f0d0481a24f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:24.707186 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dea38-de53-4263-a44e-9f0d0481a24f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:24.707575 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dea38-de53-4263-a44e-9f0d0481a24f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:24.730664 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78dea38-de53-4263-a44e-9f0d0481a24f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:24.732161 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78dea38-de53-4263-a44e-9f0d0481a24f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:24.756348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-f78dea38-de53-4263-a44e-9f0d0481a24f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:24.756348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:24.756348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:24.756348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:24.756348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:24.756348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:24.756348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:24.756348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:24.756348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:24.756348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:24.756348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:24.756348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:24.756348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:24.756348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:24.756348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:24.756348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:24.757656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:24.757656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:24.757656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:24.757656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:24.757656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:24.757656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:24.757656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:24.757656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:24.757656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:24.757656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:24.757656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:24.757656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:24.757656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:24.757656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:24.757656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:24.757656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:24.757656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:24.758474 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:24.758474 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:24.758474 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:24.758474 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 237/489] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:26:24.765141 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6407d-b28e-4678-9380-e3878bdf3ea4 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:24.809949 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:24.812210 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78dea38-de53-4263-a44e-9f0d0481a24f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:24.967874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:24.987367 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6407d-b28e-4678-9380-e3878bdf3ea4 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:25.028812 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfcbeda-9688-407b-bc12-e200e2129e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:25.029792 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcbeda-9688-407b-bc12-e200e2129e09 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:25.030302 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcbeda-9688-407b-bc12-e200e2129e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:25.030762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfcbeda-9688-407b-bc12-e200e2129e09 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:25.031796 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfcbeda-9688-407b-bc12-e200e2129e09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:25.032634 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfcbeda-9688-407b-bc12-e200e2129e09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:25.034521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfcbeda-9688-407b-bc12-e200e2129e09 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:25.041586 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78dea38-de53-4263-a44e-9f0d0481a24f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:25.050993 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 253/490] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:25.053494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfcbeda-9688-407b-bc12-e200e2129e09 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:25.090903 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7c983-8afa-43a2-ae9f-768b05153136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:25.091544 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7c983-8afa-43a2-ae9f-768b05153136 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:25.091825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7c983-8afa-43a2-ae9f-768b05153136 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:25.092682 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7c983-8afa-43a2-ae9f-768b05153136 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:25.108688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7c983-8afa-43a2-ae9f-768b05153136 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:25.115841 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-ece7c983-8afa-43a2-ae9f-768b05153136 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:26:25.115841 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:25.115841 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:25.115841 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:25.115841 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:25.115841 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:25.115841 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:25.115841 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:25.115841 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:25.115841 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:25.115841 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:25.115841 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:25.115841 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:25.115841 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:25.115841 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:25.115841 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:25.116789 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:25.116789 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:25.116789 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:25.116789 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:25.116789 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:25.116789 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:25.116789 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:25.116789 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:25.116789 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:25.116789 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:25.116789 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:25.116789 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:25.116789 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:25.116789 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:25.116789 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:25.116789 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:25.117584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:25.117584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:25.117584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:25.117584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:25.117584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:25.117584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:25.117584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:25.117584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:25.117584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:25.117584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:25.117584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:26:25.117584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:25.117584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 238/491] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 22 20:26:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:25.118781 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7c983-8afa-43a2-ae9f-768b05153136 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:25.155252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:25.181770 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfcbeda-9688-407b-bc12-e200e2129e09 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:25.216757 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad2108-cdeb-47c3-8dea-bf884b716ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:25.217381 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad2108-cdeb-47c3-8dea-bf884b716ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:25.217655 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad2108-cdeb-47c3-8dea-bf884b716ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:25.217980 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad2108-cdeb-47c3-8dea-bf884b716ab0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:25.229586 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad2108-cdeb-47c3-8dea-bf884b716ab0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:25.234657 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-34ad2108-cdeb-47c3-8dea-bf884b716ab0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:26:25.234657 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:25.234657 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:25.234657 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:25.234657 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:25.234657 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:25.234657 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:25.234657 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:25.234657 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:25.234657 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:25.234657 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:25.234657 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:25.234657 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:25.234657 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:25.234657 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:25.234657 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:25.235540 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:25.235540 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:25.235540 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:25.235540 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:25.235540 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:25.235540 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:25.235540 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:25.235540 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:25.235540 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:25.235540 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:25.235540 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:25.235540 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:25.235540 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:25.235540 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:25.235540 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:25.235540 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:25.236345 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:25.236345 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:25.236345 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:25.236345 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:25.236345 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:25.236345 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:25.236345 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:25.236345 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:25.236345 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:25.236345 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:25.236345 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:26:25.236345 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:25.236345 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 254/492] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 22 20:26:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:25.237042 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad2108-cdeb-47c3-8dea-bf884b716ab0 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:25.251103 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7c983-8afa-43a2-ae9f-768b05153136 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:25.280783 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:25.290426 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3203f7-1901-426e-822e-2ab143c680d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:25.293603 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3203f7-1901-426e-822e-2ab143c680d1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:25.293603 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3203f7-1901-426e-822e-2ab143c680d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:25.293603 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3203f7-1901-426e-822e-2ab143c680d1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:25.299692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3203f7-1901-426e-822e-2ab143c680d1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:25.301298 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3203f7-1901-426e-822e-2ab143c680d1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:25.315828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-8b3203f7-1901-426e-822e-2ab143c680d1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:26:25.315828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:25.315828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:25.315828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:25.315828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:25.315828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:25.315828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:25.315828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:25.315828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:25.315828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:25.315828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:25.315828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:25.315828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:26:25.315828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:26:25.315828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:26:25.315828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:26:25.317053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:25.317053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:25.317053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:26:25.317053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:25.317053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:26:25.317053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:25.317053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:25.317053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:25.317053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:25.317053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:25.317053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:25.317053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:25.317053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:25.317053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:25.317053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:25.317053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:25.317053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:25.317053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:25.317955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:25.317955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:25.317955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:26:25.317955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:26:25.317955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:26:25.317955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:26:25.317955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:26:25.317955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:26:25.317955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:26:25.317955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:25.321852 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 239/493] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Aug 22 20:26:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:25.323006 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b85bbb-ada6-4332-81d1-c50606d318f5 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:25.323316 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b85bbb-ada6-4332-81d1-c50606d318f5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:25.323566 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b85bbb-ada6-4332-81d1-c50606d318f5 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:25.325137 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 240/494] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:25.325839 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b85bbb-ada6-4332-81d1-c50606d318f5 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:25.351530 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad2108-cdeb-47c3-8dea-bf884b716ab0 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:25.388928 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871247e5-fbf6-4faa-9357-a3a87e770a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:25.389530 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871247e5-fbf6-4faa-9357-a3a87e770a5b None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:25.389805 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871247e5-fbf6-4faa-9357-a3a87e770a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:25.390074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871247e5-fbf6-4faa-9357-a3a87e770a5b None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:25.390728 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871247e5-fbf6-4faa-9357-a3a87e770a5b None admin] RBAC: Adding query filter params (name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:25.391025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871247e5-fbf6-4faa-9357-a3a87e770a5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:25.392384 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871247e5-fbf6-4faa-9357-a3a87e770a5b None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:25.394063 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:25.402441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 255/495] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 22 20:26:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:25.403255 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871247e5-fbf6-4faa-9357-a3a87e770a5b None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:25.441047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b85bbb-ada6-4332-81d1-c50606d318f5 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:25.474629 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f927b5-2ae6-4969-aa2a-2b337813664c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:25.475164 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f927b5-2ae6-4969-aa2a-2b337813664c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:25.475443 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f927b5-2ae6-4969-aa2a-2b337813664c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:25.475716 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f927b5-2ae6-4969-aa2a-2b337813664c None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:25.476378 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f927b5-2ae6-4969-aa2a-2b337813664c None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:25.476716 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f927b5-2ae6-4969-aa2a-2b337813664c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:25.478117 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f927b5-2ae6-4969-aa2a-2b337813664c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:25.486368 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 241/496] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 22 20:26:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:25.487519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66556772-9c8f-4bd1-b9a0-450bcf16736c None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:25.487805 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66556772-9c8f-4bd1-b9a0-450bcf16736c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:25.488079 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66556772-9c8f-4bd1-b9a0-450bcf16736c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:25.505165 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871247e5-fbf6-4faa-9357-a3a87e770a5b None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:25.506295 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-66556772-9c8f-4bd1-b9a0-450bcf16736c None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:25.507602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-66556772-9c8f-4bd1-b9a0-450bcf16736c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:25.539096 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31f49e-44a6-43e6-b98b-fa673df3dbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:25.539718 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31f49e-44a6-43e6-b98b-fa673df3dbba None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:25.539999 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31f49e-44a6-43e6-b98b-fa673df3dbba None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:25.540269 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31f49e-44a6-43e6-b98b-fa673df3dbba None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:25.541030 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31f49e-44a6-43e6-b98b-fa673df3dbba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:25.541335 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31f49e-44a6-43e6-b98b-fa673df3dbba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:25.542774 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31f49e-44a6-43e6-b98b-fa673df3dbba None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:25.555090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:25.575388 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 242/497] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:25.576615 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c504a2e-f9ee-4316-8e71-d8eb9851cd27 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:25.577259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c504a2e-f9ee-4316-8e71-d8eb9851cd27 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:25.577259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c504a2e-f9ee-4316-8e71-d8eb9851cd27 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:25.578671 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 243/498] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:25.583124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c504a2e-f9ee-4316-8e71-d8eb9851cd27 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:25.583272 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 256/499] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Aug 22 20:26:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:25.583272 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31f49e-44a6-43e6-b98b-fa673df3dbba None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:25.643717 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:25.689302 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31f49e-44a6-43e6-b98b-fa673df3dbba None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:25.698389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c504a2e-f9ee-4316-8e71-d8eb9851cd27 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:25.727087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40439c17-7e8a-42a6-8e70-6b06bd25ca72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:25.727735 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40439c17-7e8a-42a6-8e70-6b06bd25ca72 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:25.728012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40439c17-7e8a-42a6-8e70-6b06bd25ca72 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:25.728282 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40439c17-7e8a-42a6-8e70-6b06bd25ca72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:25.737085 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64e79d-646c-48ba-b45f-b4a9882e7139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:25.737711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64e79d-646c-48ba-b45f-b4a9882e7139 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:25.737987 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64e79d-646c-48ba-b45f-b4a9882e7139 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:25.738258 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64e79d-646c-48ba-b45f-b4a9882e7139 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:25.740485 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40439c17-7e8a-42a6-8e70-6b06bd25ca72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:25.742181 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40439c17-7e8a-42a6-8e70-6b06bd25ca72 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:25.749689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64e79d-646c-48ba-b45f-b4a9882e7139 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:25.751533 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64e79d-646c-48ba-b45f-b4a9882e7139 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:25.757267 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-40439c17-7e8a-42a6-8e70-6b06bd25ca72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:25.757267 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:25.757267 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:25.757267 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:25.757267 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:25.757267 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:25.757267 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:25.757267 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:25.757267 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:25.757267 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:25.757267 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:25.757267 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:25.757267 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:25.757267 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:25.757267 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:25.757267 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:25.758150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:25.758150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:25.758150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:25.758150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:25.758150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:25.758150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:25.758150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:25.758150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:25.758150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:25.758150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:25.758150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:25.758150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:25.758150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:25.758150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:25.758150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:25.758150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:25.758150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:25.758967 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:25.758967 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:25.758967 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:25.760315 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 257/500] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:25.761597 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3f9e1-6e8a-4742-a9a0-c1d8bac536c2 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:25.762018 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3f9e1-6e8a-4742-a9a0-c1d8bac536c2 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:25.762427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3f9e1-6e8a-4742-a9a0-c1d8bac536c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:25.771703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-0b64e79d-646c-48ba-b45f-b4a9882e7139 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:25.771703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:25.771703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:25.771703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:25.771703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:25.771703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:25.771703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:25.771703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:25.771703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:25.771703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:25.771703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:25.771703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:25.771703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:25.771703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:25.771703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:25.771703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:25.772609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:25.772609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:25.772609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:25.772609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:25.772609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:25.772609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:25.772609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:25.772609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:25.772609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:25.772609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:25.772609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:25.772609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:25.772609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:25.772609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:25.772609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:25.772609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:25.772609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:25.773633 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:25.773633 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:25.773633 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:25.777341 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 244/501] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:25.778168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64e79d-646c-48ba-b45f-b4a9882e7139 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:25.783969 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-21e3f9e1-6e8a-4742-a9a0-c1d8bac536c2 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:25.785757 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-21e3f9e1-6e8a-4742-a9a0-c1d8bac536c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:25.819262 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:25.863000 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 258/502] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:25.863853 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3f9e1-6e8a-4742-a9a0-c1d8bac536c2 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:25.897415 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64e79d-646c-48ba-b45f-b4a9882e7139 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:25.903490 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:25.933276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d21ebb-3922-4307-a8af-49fde4ec5ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:25.933912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d21ebb-3922-4307-a8af-49fde4ec5ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:25.934194 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d21ebb-3922-4307-a8af-49fde4ec5ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:25.934466 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d21ebb-3922-4307-a8af-49fde4ec5ad7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:25.971139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3f9e1-6e8a-4742-a9a0-c1d8bac536c2 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:26.008299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d21ebb-3922-4307-a8af-49fde4ec5ad7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:26.008570 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bac71-af52-4641-8d89-9cba2bc5a935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:26.009209 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bac71-af52-4641-8d89-9cba2bc5a935 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:26.009492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bac71-af52-4641-8d89-9cba2bc5a935 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:26.009729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d21ebb-3922-4307-a8af-49fde4ec5ad7 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:26.009834 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321bac71-af52-4641-8d89-9cba2bc5a935 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:26.010391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321bac71-af52-4641-8d89-9cba2bc5a935 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:26.010693 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321bac71-af52-4641-8d89-9cba2bc5a935 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:26.012061 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321bac71-af52-4641-8d89-9cba2bc5a935 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:26.024705 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 259/503] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:26.024861 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bac71-af52-4641-8d89-9cba2bc5a935 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:26.047071 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:26.123794 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 245/504] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:26:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:26:26.124893 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d21ebb-3922-4307-a8af-49fde4ec5ad7 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:26.133985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:26.139414 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321bac71-af52-4641-8d89-9cba2bc5a935 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:26.173502 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40688512-ab7e-4cac-a3a6-e7b6b48f4d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:26.174096 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40688512-ab7e-4cac-a3a6-e7b6b48f4d61 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:26.174371 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40688512-ab7e-4cac-a3a6-e7b6b48f4d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:26.174639 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40688512-ab7e-4cac-a3a6-e7b6b48f4d61 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:26.175268 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40688512-ab7e-4cac-a3a6-e7b6b48f4d61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:26.175562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40688512-ab7e-4cac-a3a6-e7b6b48f4d61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:26.177085 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40688512-ab7e-4cac-a3a6-e7b6b48f4d61 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:26.187855 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 260/505] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:26.188620 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40688512-ab7e-4cac-a3a6-e7b6b48f4d61 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:26.226059 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d21ebb-3922-4307-a8af-49fde4ec5ad7 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:26.255959 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:26.261445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753551c8-68d0-4860-b5db-aef67f2a89b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:26.262003 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753551c8-68d0-4860-b5db-aef67f2a89b2 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:26.262281 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753551c8-68d0-4860-b5db-aef67f2a89b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:26.262549 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753551c8-68d0-4860-b5db-aef67f2a89b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:26.273118 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753551c8-68d0-4860-b5db-aef67f2a89b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:26.277881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-753551c8-68d0-4860-b5db-aef67f2a89b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:26:26.277881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:26.277881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:26.277881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:26.277881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:26.277881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:26.277881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:26.277881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:26.277881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:26.277881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:26.277881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:26.277881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:26.277881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:26.277881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:26.277881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:26.277881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:26.278773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:26.278773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:26.278773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:26.278773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:26.278773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:26.278773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:26.278773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:26.278773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:26.278773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:26.278773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:26.278773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:26.278773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:26.278773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:26.278773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:26.278773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:26.278773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:26.279569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:26.279569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:26.279569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:26.279569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:26.279569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:26.279569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:26.279569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:26.279569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:26.279569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:26.279569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:26.279569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:26:26.279569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:26.280436 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 246/506] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 22 20:26:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:26.281628 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753551c8-68d0-4860-b5db-aef67f2a89b2 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:26.290145 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40688512-ab7e-4cac-a3a6-e7b6b48f4d61 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:26.322892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09f3fe-6720-4977-adc7-29cd54083145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:26.323509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09f3fe-6720-4977-adc7-29cd54083145 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:26.323786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09f3fe-6720-4977-adc7-29cd54083145 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:26.324062 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09f3fe-6720-4977-adc7-29cd54083145 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:26.331584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca09f3fe-6720-4977-adc7-29cd54083145 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:26.333714 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca09f3fe-6720-4977-adc7-29cd54083145 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:26.345733 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-ca09f3fe-6720-4977-adc7-29cd54083145 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 20:26:26.345733 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:26.345733 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:26.345733 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:26.345733 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:26.345733 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:26.345733 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:26.345733 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:26.345733 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:26.345733 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:26.345733 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:26.345733 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:26.345733 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:26:26.345733 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:26:26.345733 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:26:26.345733 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:26:26.346784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:26.346784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:26.346784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:26:26.346784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:26.346784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:26:26.346784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:26.346784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:26.346784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:26.346784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:26.346784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:26.346784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:26.346784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:26.346784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:26.346784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:26.346784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:26.346784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:26.346784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:26.346784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:26.347725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:26.347725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:26.347725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:26:26.347725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:26:26.347725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:26:26.347725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:26:26.347725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:26:26.347725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:26:26.347725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 20:26:26.347725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:26.347725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 261/507] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:26:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:26.347725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09f3fe-6720-4977-adc7-29cd54083145 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:26.365929 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:26.385107 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753551c8-68d0-4860-b5db-aef67f2a89b2 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:26.419285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20f12e-09ed-4645-b10a-d099fd953a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:26.419901 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20f12e-09ed-4645-b10a-d099fd953a11 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:26.420177 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20f12e-09ed-4645-b10a-d099fd953a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:26.420446 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20f12e-09ed-4645-b10a-d099fd953a11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:26.432059 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20f12e-09ed-4645-b10a-d099fd953a11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:26.433648 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20f12e-09ed-4645-b10a-d099fd953a11 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:26.448342 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-ec20f12e-09ed-4645-b10a-d099fd953a11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:26.448342 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:26.448342 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:26.448342 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:26.448342 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:26.448342 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:26.448342 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:26.448342 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:26.448342 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:26.448342 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:26.448342 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:26.448342 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:26.448342 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:26.448342 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:26.448342 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:26.448342 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:26.449400 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:26.449400 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:26.449400 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:26.449400 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:26.449400 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:26.449400 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:26.449400 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:26.449400 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:26.449400 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:26.449400 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:26.449400 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:26.449400 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:26.449400 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:26.449400 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:26.449400 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:26.449400 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:26.449400 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:26.450257 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:26.450257 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:26.450257 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:26.450257 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 247/508] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:26.450257 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20f12e-09ed-4645-b10a-d099fd953a11 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:26.451166 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09f3fe-6720-4977-adc7-29cd54083145 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:26.489494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44280a3e-6f13-445f-89fb-e69da68108db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:26.490618 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44280a3e-6f13-445f-89fb-e69da68108db None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:26.490896 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44280a3e-6f13-445f-89fb-e69da68108db None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:26.491167 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44280a3e-6f13-445f-89fb-e69da68108db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:26.500349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:26.500931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44280a3e-6f13-445f-89fb-e69da68108db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:26.502396 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44280a3e-6f13-445f-89fb-e69da68108db None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:26.517855 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-44280a3e-6f13-445f-89fb-e69da68108db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:26.517855 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:26.517855 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:26.517855 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:26.517855 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:26.517855 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:26.517855 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:26.517855 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:26.517855 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:26.517855 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:26.517855 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:26.517855 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:26.517855 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:26.517855 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:26.517855 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:26.517855 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:26.518903 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:26.518903 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:26.518903 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:26.518903 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:26.518903 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:26.518903 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:26.518903 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:26.518903 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:26.518903 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:26.518903 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:26.518903 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:26.518903 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:26.518903 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:26.518903 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:26.518903 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:26.518903 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:26.518903 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:26.519731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:26.519731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:26.519731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:26.519731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 262/509] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:26.519945 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44280a3e-6f13-445f-89fb-e69da68108db None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:26.556157 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20f12e-09ed-4645-b10a-d099fd953a11 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:26.586750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:26.590012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9b870-d4b8-4170-9c55-ac286c630c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:26.636997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9b870-d4b8-4170-9c55-ac286c630c34 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:26.636997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9b870-d4b8-4170-9c55-ac286c630c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:26.636997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9b870-d4b8-4170-9c55-ac286c630c34 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:26.636997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9b870-d4b8-4170-9c55-ac286c630c34 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:26.636997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9b870-d4b8-4170-9c55-ac286c630c34 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:26.636997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-cbe9b870-d4b8-4170-9c55-ac286c630c34 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 22 20:26:26.636997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:26.637561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:26.637561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:26.637561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:26.637561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:26.637561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:26.637561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:26.637561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:26.637561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:26.637561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:26.637561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:26.637561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:26:26.637561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:26:26.637561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:26:26.637561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:26:26.637561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:26.637561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:26.637561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:26:26.638588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:26.638588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:26:26.638588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:26.638588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:26.638588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:26.638588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:26.638588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:26.638588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:26.638588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:26.638588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:26.638588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:26.638588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:26.638588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:26.638588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:26.638588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:26.638588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:26.638588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:26.639604 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:26:26.639604 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:26:26.639604 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:26:26.639604 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:26:26.639604 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:26:26.639604 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:26:26.639604 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 22 20:26:26.639604 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:26.639604 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 248/510] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:26:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:26.639604 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9b870-d4b8-4170-9c55-ac286c630c34 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:26.640243 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44280a3e-6f13-445f-89fb-e69da68108db None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:26.656592 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47557fc-16a8-4459-aff4-d7a6bb8f466f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:26.657226 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47557fc-16a8-4459-aff4-d7a6bb8f466f None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:26.657492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47557fc-16a8-4459-aff4-d7a6bb8f466f None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:26.657764 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47557fc-16a8-4459-aff4-d7a6bb8f466f None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:26.658424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47557fc-16a8-4459-aff4-d7a6bb8f466f None admin] RBAC: Adding query filter params (name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:26.658729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47557fc-16a8-4459-aff4-d7a6bb8f466f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:26.660104 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47557fc-16a8-4459-aff4-d7a6bb8f466f None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:26.667943 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 263/511] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 22 20:26:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:26.668762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47557fc-16a8-4459-aff4-d7a6bb8f466f None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:26.718328 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9b870-d4b8-4170-9c55-ac286c630c34 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:26.720646 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:26.752645 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff17dc-1347-403f-badb-380351963729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:26.753266 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff17dc-1347-403f-badb-380351963729 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:26.753539 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff17dc-1347-403f-badb-380351963729 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:26.753807 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff17dc-1347-403f-badb-380351963729 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:26.754538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff17dc-1347-403f-badb-380351963729 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:26.754827 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff17dc-1347-403f-badb-380351963729 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:26.756248 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff17dc-1347-403f-badb-380351963729 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:26.769102 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47557fc-16a8-4459-aff4-d7a6bb8f466f None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:26.792314 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 249/512] 10.222.0.62 () {56 vars in 1137 bytes} [Mon Aug 22 20:26:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:26.793000 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff17dc-1347-403f-badb-380351963729 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:26.799098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:26.807485 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada7e33-e423-44d1-be24-ee3073092eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:26.808092 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada7e33-e423-44d1-be24-ee3073092eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:26.808374 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada7e33-e423-44d1-be24-ee3073092eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:26.808651 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada7e33-e423-44d1-be24-ee3073092eb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:26.809394 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada7e33-e423-44d1-be24-ee3073092eb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:26.809775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada7e33-e423-44d1-be24-ee3073092eb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:26.811159 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada7e33-e423-44d1-be24-ee3073092eb3 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:26.823178 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 264/513] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:26.824045 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada7e33-e423-44d1-be24-ee3073092eb3 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:26.900354 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff17dc-1347-403f-badb-380351963729 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:26.923942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada7e33-e423-44d1-be24-ee3073092eb3 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:26.935425 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedec61f-e62a-4092-8956-4a5fd1f06c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:26.936030 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedec61f-e62a-4092-8956-4a5fd1f06c44 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:26.936312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedec61f-e62a-4092-8956-4a5fd1f06c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:26.936593 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedec61f-e62a-4092-8956-4a5fd1f06c44 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:26.937266 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedec61f-e62a-4092-8956-4a5fd1f06c44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:26.937570 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedec61f-e62a-4092-8956-4a5fd1f06c44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:26.938952 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedec61f-e62a-4092-8956-4a5fd1f06c44 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:26.950586 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 250/514] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:26.951393 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedec61f-e62a-4092-8956-4a5fd1f06c44 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:26.963589 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b627ea-2e8d-44c3-a45e-bd391d486c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:26.964195 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b627ea-2e8d-44c3-a45e-bd391d486c1a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:26.964471 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b627ea-2e8d-44c3-a45e-bd391d486c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:26.964783 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b627ea-2e8d-44c3-a45e-bd391d486c1a None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:26.965496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b627ea-2e8d-44c3-a45e-bd391d486c1a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:26.965797 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b627ea-2e8d-44c3-a45e-bd391d486c1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:26.967221 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b627ea-2e8d-44c3-a45e-bd391d486c1a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:26.976485 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:26.984207 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 265/515] 10.222.0.62 () {56 vars in 1137 bytes} [Mon Aug 22 20:26:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:26.985040 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b627ea-2e8d-44c3-a45e-bd391d486c1a None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:27.033145 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:27.052066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedec61f-e62a-4092-8956-4a5fd1f06c44 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:27.085022 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b627ea-2e8d-44c3-a45e-bd391d486c1a None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:27.085973 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fba786-3af9-4d7c-89cc-4d368cd94485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:27.086599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fba786-3af9-4d7c-89cc-4d368cd94485 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:27.086878 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fba786-3af9-4d7c-89cc-4d368cd94485 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:27.087155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fba786-3af9-4d7c-89cc-4d368cd94485 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:27.097416 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fba786-3af9-4d7c-89cc-4d368cd94485 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:27.100079 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fba786-3af9-4d7c-89cc-4d368cd94485 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:27.114563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-79fba786-3af9-4d7c-89cc-4d368cd94485 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:27.114563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:27.114563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:27.114563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:27.114563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:27.114563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:27.114563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:27.114563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:27.114563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:27.114563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:27.114563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:27.114563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:27.114563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:27.114563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:27.114563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:27.114563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:27.115602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:27.115602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:27.115602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:27.115602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:27.115602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:27.115602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:27.115602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:27.115602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:27.115602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:27.115602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:27.115602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:27.115602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:27.115602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:27.115602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:27.115602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:27.115602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:27.115602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:27.116488 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:27.116488 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:27.116488 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:27.116488 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 251/516] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:27.116746 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fba786-3af9-4d7c-89cc-4d368cd94485 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:27.120713 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1630d5a-46d7-412e-8f11-4a751a34a437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:27.121316 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1630d5a-46d7-412e-8f11-4a751a34a437 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:27.121599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1630d5a-46d7-412e-8f11-4a751a34a437 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:27.121871 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1630d5a-46d7-412e-8f11-4a751a34a437 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:27.191292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1630d5a-46d7-412e-8f11-4a751a34a437 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:27.192153 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:27.193342 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1630d5a-46d7-412e-8f11-4a751a34a437 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:27.217298 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fba786-3af9-4d7c-89cc-4d368cd94485 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:27.242102 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:27.251754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4bc32c-a512-4d92-bef4-c194d2ecbb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:27.252381 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bc32c-a512-4d92-bef4-c194d2ecbb04 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:27.252682 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bc32c-a512-4d92-bef4-c194d2ecbb04 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:27.252951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bc32c-a512-4d92-bef4-c194d2ecbb04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:27.259701 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4bc32c-a512-4d92-bef4-c194d2ecbb04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:27.261360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4bc32c-a512-4d92-bef4-c194d2ecbb04 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:27.274082 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-6d4bc32c-a512-4d92-bef4-c194d2ecbb04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:27.274082 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:27.274082 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:27.274082 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:27.274082 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:27.274082 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:27.274082 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:27.274082 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:27.274082 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:27.274082 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:27.274082 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:27.274082 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:27.274082 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:26:27.274082 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:26:27.274082 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:26:27.275180 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:26:27.275180 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:27.275180 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:27.275180 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:27.275180 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:27.275180 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:27.275180 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:27.275180 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:27.275180 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:27.275180 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:27.275180 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:27.275180 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:27.275180 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:27.275180 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:27.275180 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:27.275180 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:27.275180 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:27.276159 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:26:27.276159 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:26:27.276159 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:26:27.276159 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:26:27.276159 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:26:27.276159 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:26:27.276159 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:27.276159 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:27.276159 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 252/517] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:26:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:27.276159 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4bc32c-a512-4d92-bef4-c194d2ecbb04 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:27.296359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 266/518] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:26:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:26:27.297241 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1630d5a-46d7-412e-8f11-4a751a34a437 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:27.381011 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4bc32c-a512-4d92-bef4-c194d2ecbb04 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:27.397794 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1630d5a-46d7-412e-8f11-4a751a34a437 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:27.415352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37141ba0-4e9c-4b9a-8731-32b684353b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:27.415953 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37141ba0-4e9c-4b9a-8731-32b684353b35 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:27.416233 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37141ba0-4e9c-4b9a-8731-32b684353b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:27.416509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37141ba0-4e9c-4b9a-8731-32b684353b35 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:27.417176 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37141ba0-4e9c-4b9a-8731-32b684353b35 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:27.418650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37141ba0-4e9c-4b9a-8731-32b684353b35 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:27.426693 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:27.431819 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398f8dc-f354-43f3-99bd-361da28ba989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:27.432411 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398f8dc-f354-43f3-99bd-361da28ba989 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:27.432712 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398f8dc-f354-43f3-99bd-361da28ba989 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:27.433004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1398f8dc-f354-43f3-99bd-361da28ba989 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:27.449989 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:27.496207 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 253/519] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Aug 22 20:26:27 2022] POST /identity/v3/users => generated 247 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:26:27.497146 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37141ba0-4e9c-4b9a-8731-32b684353b35 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:27.498828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398f8dc-f354-43f3-99bd-361da28ba989 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:27.500302 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1398f8dc-f354-43f3-99bd-361da28ba989 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:27.618730 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 267/520] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:26:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:26:27.619910 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398f8dc-f354-43f3-99bd-361da28ba989 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:27.622790 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37141ba0-4e9c-4b9a-8731-32b684353b35 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:27.664760 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77b32f-7cd0-43d9-81a1-cde44cd0f62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:27.665469 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77b32f-7cd0-43d9-81a1-cde44cd0f62d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:27.666035 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77b32f-7cd0-43d9-81a1-cde44cd0f62d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:27.666319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77b32f-7cd0-43d9-81a1-cde44cd0f62d None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:27.667288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d77b32f-7cd0-43d9-81a1-cde44cd0f62d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:27.667612 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d77b32f-7cd0-43d9-81a1-cde44cd0f62d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:27.669568 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d77b32f-7cd0-43d9-81a1-cde44cd0f62d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:27.673313 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:27.684366 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 254/521] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:27.685244 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77b32f-7cd0-43d9-81a1-cde44cd0f62d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:27.733646 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1398f8dc-f354-43f3-99bd-361da28ba989 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:27.739758 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:27.775070 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324352b-1df0-4182-8d51-8eb97dc471d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:27.775880 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324352b-1df0-4182-8d51-8eb97dc471d3 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:27.776063 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324352b-1df0-4182-8d51-8eb97dc471d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:27.776473 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324352b-1df0-4182-8d51-8eb97dc471d3 None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:27.777267 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324352b-1df0-4182-8d51-8eb97dc471d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:27.777519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324352b-1df0-4182-8d51-8eb97dc471d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:27.779020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0324352b-1df0-4182-8d51-8eb97dc471d3 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:27.797154 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77b32f-7cd0-43d9-81a1-cde44cd0f62d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:27.803726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 268/522] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 22 20:26:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:27.803726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324352b-1df0-4182-8d51-8eb97dc471d3 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:27.841421 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202eac4-cb7b-49d0-a1cb-d9f4d8b0f676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:27.842057 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202eac4-cb7b-49d0-a1cb-d9f4d8b0f676 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:27.842335 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202eac4-cb7b-49d0-a1cb-d9f4d8b0f676 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:27.842606 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202eac4-cb7b-49d0-a1cb-d9f4d8b0f676 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:27.854280 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202eac4-cb7b-49d0-a1cb-d9f4d8b0f676 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:27.855756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202eac4-cb7b-49d0-a1cb-d9f4d8b0f676 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:27.873149 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-3202eac4-cb7b-49d0-a1cb-d9f4d8b0f676 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:27.873149 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:27.873149 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:27.873149 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:27.873149 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:27.873149 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:27.873149 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:27.873149 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:27.873149 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:27.873149 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:27.873149 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:27.873149 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:27.873149 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:27.873149 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:27.873149 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:27.873149 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:27.874042 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:27.874042 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:27.874042 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:27.874042 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:27.874042 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:27.874042 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:27.874042 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:27.874042 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:27.874042 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:27.874042 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:27.874042 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:27.874042 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:27.874042 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:27.874042 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:27.874042 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:27.874042 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:27.874042 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:27.874863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:27.874863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:27.874863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:27.874863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 255/523] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:27.875069 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202eac4-cb7b-49d0-a1cb-d9f4d8b0f676 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:27.914523 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324352b-1df0-4182-8d51-8eb97dc471d3 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:27.923666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:27.947702 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6562d8-e85a-49a5-976e-c1d2576a1a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:27.948326 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6562d8-e85a-49a5-976e-c1d2576a1a7b None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:27.948601 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6562d8-e85a-49a5-976e-c1d2576a1a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:27.948908 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6562d8-e85a-49a5-976e-c1d2576a1a7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:27.960276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6562d8-e85a-49a5-976e-c1d2576a1a7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:27.961760 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6562d8-e85a-49a5-976e-c1d2576a1a7b None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:27.977353 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-2b6562d8-e85a-49a5-976e-c1d2576a1a7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:27.977353 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:27.977353 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:27.977353 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:27.977353 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:27.977353 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:27.977353 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:27.977353 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:27.977353 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:27.977353 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:27.977353 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:27.977353 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:27.977353 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:27.977353 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:27.977353 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:27.977353 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:27.978300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:27.978300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:27.978300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:27.978300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:27.978300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:27.978300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:27.978300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:27.978300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:27.978300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:27.978300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:27.978300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:27.978300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:27.978300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:27.978300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:27.978300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:27.978300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:27.978300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:27.979198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:27.979198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:27.979198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:27.979198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 269/524] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:27.979974 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6562d8-e85a-49a5-976e-c1d2576a1a7b None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:27.983839 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202eac4-cb7b-49d0-a1cb-d9f4d8b0f676 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:27.985522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:28.023061 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbd3a2-8b7f-4e8d-99eb-fd5168632133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:28.023788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbd3a2-8b7f-4e8d-99eb-fd5168632133 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:28.024130 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbd3a2-8b7f-4e8d-99eb-fd5168632133 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:28.024466 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbd3a2-8b7f-4e8d-99eb-fd5168632133 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:28.032360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bbd3a2-8b7f-4e8d-99eb-fd5168632133 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:28.033910 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bbd3a2-8b7f-4e8d-99eb-fd5168632133 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:28.045784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-84bbd3a2-8b7f-4e8d-99eb-fd5168632133 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 20:26:28.045784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:28.045784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:28.045784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:28.045784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:28.045784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:28.045784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:28.045784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:28.045784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:28.045784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:28.045784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:28.045784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:28.045784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:26:28.045784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:26:28.045784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:26:28.045784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:26:28.046872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:28.046872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:28.046872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:26:28.046872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:28.046872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:26:28.046872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:28.046872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:28.046872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:28.046872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:28.046872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:28.046872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:28.046872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:28.046872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:28.046872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:28.046872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:28.046872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:28.046872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:28.046872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:28.047963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:28.047963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:28.047963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:26:28.047963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:26:28.047963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:26:28.047963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:26:28.047963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:26:28.047963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:26:28.047963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 20:26:28.047963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:28.049300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 256/525] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 22 20:26:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:28.050127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbd3a2-8b7f-4e8d-99eb-fd5168632133 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:28.101071 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6562d8-e85a-49a5-976e-c1d2576a1a7b None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:28.134896 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f81a12-d78d-4200-83d7-b145f3647170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:28.135413 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f81a12-d78d-4200-83d7-b145f3647170 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:28.135688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f81a12-d78d-4200-83d7-b145f3647170 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:28.135955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f81a12-d78d-4200-83d7-b145f3647170 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:28.136681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f81a12-d78d-4200-83d7-b145f3647170 None admin] RBAC: Adding query filter params (role.id=38bb7e6ed5854439aeaf5996eb6892f6, scope.project.id=783c362712d34405ab827e3f00a67995, user.id=9f1738f72b4848499cdf0ec6866c3c8f) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:28.136996 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f81a12-d78d-4200-83d7-b145f3647170 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:28.138453 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f81a12-d78d-4200-83d7-b145f3647170 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:28.143849 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 270/526] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:26:27 2022] GET /identity/v3/role_assignments?user.id=9f1738f72b4848499cdf0ec6866c3c8f&scope.project.id=783c362712d34405ab827e3f00a67995&role.id=38bb7e6ed5854439aeaf5996eb6892f6 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:28.144634 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f81a12-d78d-4200-83d7-b145f3647170 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:28.180792 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbd3a2-8b7f-4e8d-99eb-fd5168632133 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:28.185297 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:28.221425 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273ecc7-4682-4107-bb19-1a323e4ed44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:28.222147 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273ecc7-4682-4107-bb19-1a323e4ed44a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:28.222425 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273ecc7-4682-4107-bb19-1a323e4ed44a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:28.222697 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c273ecc7-4682-4107-bb19-1a323e4ed44a None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:28.223908 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c273ecc7-4682-4107-bb19-1a323e4ed44a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:28.224165 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c273ecc7-4682-4107-bb19-1a323e4ed44a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:28.225738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c273ecc7-4682-4107-bb19-1a323e4ed44a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:28.244746 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 257/527] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:28.244746 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273ecc7-4682-4107-bb19-1a323e4ed44a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:28.272928 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:28.298564 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f81a12-d78d-4200-83d7-b145f3647170 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:28.335269 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141209f-8009-44ac-8310-2b59fd74f6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:28.336346 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141209f-8009-44ac-8310-2b59fd74f6d2 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:28.336778 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141209f-8009-44ac-8310-2b59fd74f6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:28.337145 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141209f-8009-44ac-8310-2b59fd74f6d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:28.337985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141209f-8009-44ac-8310-2b59fd74f6d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:28.338378 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141209f-8009-44ac-8310-2b59fd74f6d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:28.339822 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141209f-8009-44ac-8310-2b59fd74f6d2 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:28.355033 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 271/528] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:28.356266 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141209f-8009-44ac-8310-2b59fd74f6d2 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:28.379423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c273ecc7-4682-4107-bb19-1a323e4ed44a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:28.431711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a73db-afc1-4234-959c-b35cfd8ad7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:28.432486 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a73db-afc1-4234-959c-b35cfd8ad7b1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:28.432892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a73db-afc1-4234-959c-b35cfd8ad7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:28.433256 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a73db-afc1-4234-959c-b35cfd8ad7b1 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:28.434489 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a73db-afc1-4234-959c-b35cfd8ad7b1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:28.434899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a73db-afc1-4234-959c-b35cfd8ad7b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:28.436838 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a73db-afc1-4234-959c-b35cfd8ad7b1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:28.456616 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 258/529] 10.222.0.62 () {56 vars in 1139 bytes} [Mon Aug 22 20:26:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:28.458319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a73db-afc1-4234-959c-b35cfd8ad7b1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:28.458562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:28.471810 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141209f-8009-44ac-8310-2b59fd74f6d2 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:28.517826 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37adabdb-d58a-4476-8c28-36bb6a268fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:28.518464 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adabdb-d58a-4476-8c28-36bb6a268fdf None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:28.518743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adabdb-d58a-4476-8c28-36bb6a268fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:28.519008 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adabdb-d58a-4476-8c28-36bb6a268fdf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:28.527174 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37adabdb-d58a-4476-8c28-36bb6a268fdf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:28.528575 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37adabdb-d58a-4476-8c28-36bb6a268fdf None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:28.541128 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-37adabdb-d58a-4476-8c28-36bb6a268fdf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:28.541128 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:28.541128 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:28.541128 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:28.541128 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:28.541128 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:28.541128 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:28.541128 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:28.541128 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:28.541128 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:28.541128 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:28.541128 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:28.541128 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:26:28.541128 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:26:28.541128 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:26:28.542198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:26:28.542198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:28.542198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:28.542198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:28.542198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:28.542198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:28.542198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:28.542198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:28.542198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:28.542198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:28.542198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:28.542198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:28.542198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:28.542198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:28.542198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:28.542198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:28.542198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:28.543216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:26:28.543216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:26:28.543216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:26:28.543216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:26:28.543216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:26:28.543216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:26:28.543216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:28.543216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:28.543216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 272/530] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:26:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:28.543681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37adabdb-d58a-4476-8c28-36bb6a268fdf None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:28.557254 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:28.579241 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a73db-afc1-4234-959c-b35cfd8ad7b1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:28.619001 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cadd61d-2ac6-4673-bc76-3b367a0c12af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:28.619998 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadd61d-2ac6-4673-bc76-3b367a0c12af None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:28.620432 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadd61d-2ac6-4673-bc76-3b367a0c12af None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:28.620899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadd61d-2ac6-4673-bc76-3b367a0c12af None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:28.629018 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cadd61d-2ac6-4673-bc76-3b367a0c12af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:28.631123 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cadd61d-2ac6-4673-bc76-3b367a0c12af None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:28.644229 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-6cadd61d-2ac6-4673-bc76-3b367a0c12af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:28.644229 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:28.644229 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:28.644229 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:28.644229 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:28.644229 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:28.644229 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:28.644229 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:28.644229 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:28.644229 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:28.644229 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:28.644229 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:28.644229 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:26:28.644229 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:26:28.644229 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:26:28.645883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:26:28.645883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:28.645883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:28.645883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:28.645883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:28.645883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:28.645883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:28.645883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:28.645883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:28.645883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:28.645883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:28.645883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:28.645883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:28.645883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:28.645883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:28.645883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:28.645883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:28.646730 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:26:28.646730 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:26:28.646730 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:26:28.646730 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:26:28.646730 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:26:28.646730 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:26:28.646730 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:28.646730 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:28.652940 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37adabdb-d58a-4476-8c28-36bb6a268fdf None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:28.653201 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 259/531] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:26:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:28.654208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cadd61d-2ac6-4673-bc76-3b367a0c12af None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:28.697276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520409d-cf99-44e6-be0b-550bb99fb8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:28.698128 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520409d-cf99-44e6-be0b-550bb99fb8c7 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:28.698554 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520409d-cf99-44e6-be0b-550bb99fb8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:28.698966 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520409d-cf99-44e6-be0b-550bb99fb8c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:28.720781 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:28.765669 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cadd61d-2ac6-4673-bc76-3b367a0c12af None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:28.809177 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520409d-cf99-44e6-be0b-550bb99fb8c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:28.811485 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520409d-cf99-44e6-be0b-550bb99fb8c7 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:28.812154 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afce12e-6f68-4e82-9923-48d371f7aae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:28.812920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afce12e-6f68-4e82-9923-48d371f7aae9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:28.813299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afce12e-6f68-4e82-9923-48d371f7aae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:28.813668 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afce12e-6f68-4e82-9923-48d371f7aae9 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:28.814462 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afce12e-6f68-4e82-9923-48d371f7aae9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:28.814869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afce12e-6f68-4e82-9923-48d371f7aae9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:28.816386 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afce12e-6f68-4e82-9923-48d371f7aae9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:28.832402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:28.837423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 260/532] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 22 20:26:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:28.838380 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afce12e-6f68-4e82-9923-48d371f7aae9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:28.948402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afce12e-6f68-4e82-9923-48d371f7aae9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:28.959879 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 273/533] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:26:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:26:28.959879 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520409d-cf99-44e6-be0b-550bb99fb8c7 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:28.990025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d16948-9642-41be-80bc-a5219ffabd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:28.990674 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d16948-9642-41be-80bc-a5219ffabd75 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:28.990954 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d16948-9642-41be-80bc-a5219ffabd75 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:28.991227 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d16948-9642-41be-80bc-a5219ffabd75 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:28.992058 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d16948-9642-41be-80bc-a5219ffabd75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:28.992263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d16948-9642-41be-80bc-a5219ffabd75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:28.993813 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d16948-9642-41be-80bc-a5219ffabd75 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:29.010880 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 261/534] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 22 20:26:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:29.010880 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d16948-9642-41be-80bc-a5219ffabd75 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:29.020170 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:29.081171 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520409d-cf99-44e6-be0b-550bb99fb8c7 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:29.088529 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:29.126337 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c40fdc-ec2d-4cd5-ad8e-580e19fd7051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:29.127241 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c40fdc-ec2d-4cd5-ad8e-580e19fd7051 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:29.127864 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c40fdc-ec2d-4cd5-ad8e-580e19fd7051 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:29.128325 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c40fdc-ec2d-4cd5-ad8e-580e19fd7051 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:29.129932 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c40fdc-ec2d-4cd5-ad8e-580e19fd7051 None admin] RBAC: Adding query filter params (role.id=38bb7e6ed5854439aeaf5996eb6892f6, scope.project.id=783c362712d34405ab827e3f00a67995, user.id=893e204cfff74570b3226b2e8c47df57) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:29.130430 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c40fdc-ec2d-4cd5-ad8e-580e19fd7051 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:29.132539 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c40fdc-ec2d-4cd5-ad8e-580e19fd7051 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:29.135073 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d16948-9642-41be-80bc-a5219ffabd75 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:29.139795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 274/535] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:26:28 2022] GET /identity/v3/role_assignments?user.id=893e204cfff74570b3226b2e8c47df57&scope.project.id=783c362712d34405ab827e3f00a67995&role.id=38bb7e6ed5854439aeaf5996eb6892f6 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:29.140808 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c40fdc-ec2d-4cd5-ad8e-580e19fd7051 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:29.211179 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1171c-7d42-4977-b1b5-922ff53fe0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:29.211751 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1171c-7d42-4977-b1b5-922ff53fe0b2 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:29.212030 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1171c-7d42-4977-b1b5-922ff53fe0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:29.212301 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1171c-7d42-4977-b1b5-922ff53fe0b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:29.241981 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1171c-7d42-4977-b1b5-922ff53fe0b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:29.243495 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1171c-7d42-4977-b1b5-922ff53fe0b2 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:29.274060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-29e1171c-7d42-4977-b1b5-922ff53fe0b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:29.274060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:29.274060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:29.274060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:29.274060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:29.274060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:29.274060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:29.274060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:29.274060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:29.274060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:29.274060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:29.274060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:29.274060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:29.274060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:29.274060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:29.274060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:29.275106 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:29.275106 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:29.275106 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:29.275106 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:29.275106 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:29.275106 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:29.275106 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:29.275106 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:29.275106 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:29.275106 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:29.275106 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:29.275106 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:29.275106 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:29.275106 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:29.275106 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:29.275106 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:29.275106 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:29.275928 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:29.275928 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:29.275928 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:29.275928 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 262/536] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:29.283730 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1171c-7d42-4977-b1b5-922ff53fe0b2 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:29.338474 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c40fdc-ec2d-4cd5-ad8e-580e19fd7051 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:29.348286 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:29.382378 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e920af16-32c0-4851-b1ad-64015e8f1479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:29.383370 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920af16-32c0-4851-b1ad-64015e8f1479 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:29.383850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920af16-32c0-4851-b1ad-64015e8f1479 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:29.384318 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920af16-32c0-4851-b1ad-64015e8f1479 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:29.385292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e920af16-32c0-4851-b1ad-64015e8f1479 None admin] RBAC: Adding query filter params (role.id=38bb7e6ed5854439aeaf5996eb6892f6, scope.project.id=783c362712d34405ab827e3f00a67995, user.id=d4e298bcbaf84866b4fc6c6f65216fc5) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:29.385830 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e920af16-32c0-4851-b1ad-64015e8f1479 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:29.388754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e920af16-32c0-4851-b1ad-64015e8f1479 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:29.396469 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 275/537] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:26:29 2022] GET /identity/v3/role_assignments?user.id=d4e298bcbaf84866b4fc6c6f65216fc5&scope.project.id=783c362712d34405ab827e3f00a67995&role.id=38bb7e6ed5854439aeaf5996eb6892f6 => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:29.428483 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1171c-7d42-4977-b1b5-922ff53fe0b2 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:29.445393 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:29.470146 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca99e8-6c5f-4f86-876c-a6ecc4cf059a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:29.471153 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca99e8-6c5f-4f86-876c-a6ecc4cf059a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:29.471647 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca99e8-6c5f-4f86-876c-a6ecc4cf059a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:29.472219 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca99e8-6c5f-4f86-876c-a6ecc4cf059a None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:29.473125 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca99e8-6c5f-4f86-876c-a6ecc4cf059a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:29.473627 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca99e8-6c5f-4f86-876c-a6ecc4cf059a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:29.475301 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca99e8-6c5f-4f86-876c-a6ecc4cf059a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:29.488579 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6913b3-f449-4d89-8dae-2c3cc5d04151 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:29.489444 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6913b3-f449-4d89-8dae-2c3cc5d04151 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:29.489692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6913b3-f449-4d89-8dae-2c3cc5d04151 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:29.491263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 276/538] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:26:29.495643 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 263/539] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:29.499987 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab64a3-66ee-424f-b883-9bf7f8a0ccbe None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:29.499987 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab64a3-66ee-424f-b883-9bf7f8a0ccbe None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:29.499987 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab64a3-66ee-424f-b883-9bf7f8a0ccbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:29.501207 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca99e8-6c5f-4f86-876c-a6ecc4cf059a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:29.530579 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-29ab64a3-66ee-424f-b883-9bf7f8a0ccbe None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:29.531808 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-29ab64a3-66ee-424f-b883-9bf7f8a0ccbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:29.645966 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 277/540] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:26:29.686842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca99e8-6c5f-4f86-876c-a6ecc4cf059a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:29.728277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f8490-7ef2-4050-95da-a8dda148f193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:29.728849 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f8490-7ef2-4050-95da-a8dda148f193 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:29.729125 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f8490-7ef2-4050-95da-a8dda148f193 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:29.729391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f8490-7ef2-4050-95da-a8dda148f193 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:29.736618 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f8490-7ef2-4050-95da-a8dda148f193 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:29.738133 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f8490-7ef2-4050-95da-a8dda148f193 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:29.755777 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-844f8490-7ef2-4050-95da-a8dda148f193 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:29.755777 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:29.755777 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:29.755777 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:29.755777 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:29.755777 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:29.755777 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:29.755777 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:29.755777 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:29.755777 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:29.755777 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:29.755777 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:29.755777 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:26:29.755777 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:26:29.755777 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:26:29.756649 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:26:29.756649 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:29.756649 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:29.756649 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:29.756649 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:29.756649 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:29.756649 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:29.756649 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:29.756649 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:29.756649 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:29.756649 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:29.756649 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:29.756649 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:29.756649 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:29.756649 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:29.756649 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:29.756649 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:29.757509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:26:29.757509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:26:29.757509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:26:29.757509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:26:29.757509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:26:29.757509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:26:29.757509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:29.757509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:29.757509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 264/541] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:26:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:29.762582 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab64a3-66ee-424f-b883-9bf7f8a0ccbe None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:29.918701 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab64a3-66ee-424f-b883-9bf7f8a0ccbe None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:29.920165 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:29.960232 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a86a9-1459-46bb-badb-451a504e3827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:29.960874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a86a9-1459-46bb-badb-451a504e3827 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:29.961381 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a86a9-1459-46bb-badb-451a504e3827 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:29.961842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a86a9-1459-46bb-badb-451a504e3827 None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:29.962868 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a86a9-1459-46bb-badb-451a504e3827 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:29.963170 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a86a9-1459-46bb-badb-451a504e3827 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:29.964595 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a86a9-1459-46bb-badb-451a504e3827 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:29.981464 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 278/542] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 22 20:26:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:29.987643 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f8490-7ef2-4050-95da-a8dda148f193 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:29.993555 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a86a9-1459-46bb-badb-451a504e3827 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:30.050199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:30.095836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a86a9-1459-46bb-badb-451a504e3827 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:30.138692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da04a5-4faa-432a-aae8-b8aa79b9a9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:30.139333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da04a5-4faa-432a-aae8-b8aa79b9a9d3 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:30.139607 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da04a5-4faa-432a-aae8-b8aa79b9a9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:30.139870 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da04a5-4faa-432a-aae8-b8aa79b9a9d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:30.150035 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f8490-7ef2-4050-95da-a8dda148f193 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:30.161905 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da04a5-4faa-432a-aae8-b8aa79b9a9d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:30.174230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-49da04a5-4faa-432a-aae8-b8aa79b9a9d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:26:30.174230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:30.174230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:30.174230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:30.174230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:30.174230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:30.174230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:30.174230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:30.174230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:30.174230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:30.174230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:30.174230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:30.174230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:30.174230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:30.174230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:30.174230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:30.175139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:30.175139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:30.175139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:30.175139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:30.175139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:30.175139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:30.175139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:30.175139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:30.175139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:30.175139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:30.175139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:30.175139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:30.175139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:30.175139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:30.175139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:30.175139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:30.178383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:30.178383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:30.178383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:30.178383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:30.178383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:30.178383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:30.178383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:30.178383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:30.178383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:30.178383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:30.178383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:26:30.178383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:30.178383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 279/543] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 22 20:26:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:26:30.186546 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da04a5-4faa-432a-aae8-b8aa79b9a9d3 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:30.205499 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a069818-504a-488d-a31a-4e009499bb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:30.206111 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a069818-504a-488d-a31a-4e009499bb51 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:30.206390 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a069818-504a-488d-a31a-4e009499bb51 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:30.206659 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a069818-504a-488d-a31a-4e009499bb51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:30.207426 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a069818-504a-488d-a31a-4e009499bb51 None admin] RBAC: Adding query filter params (role.id=38bb7e6ed5854439aeaf5996eb6892f6, scope.project.id=783c362712d34405ab827e3f00a67995, user.id=538ba8188ed540628242c983ebd6dd1f) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:30.207856 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a069818-504a-488d-a31a-4e009499bb51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:30.209667 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a069818-504a-488d-a31a-4e009499bb51 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:30.221069 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 265/544] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:26:29 2022] GET /identity/v3/role_assignments?user.id=538ba8188ed540628242c983ebd6dd1f&scope.project.id=783c362712d34405ab827e3f00a67995&role.id=38bb7e6ed5854439aeaf5996eb6892f6 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:30.236130 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:30.353004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da04a5-4faa-432a-aae8-b8aa79b9a9d3 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:30.396434 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bab641-5c2b-413a-8172-48742c1ebc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:30.397438 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bab641-5c2b-413a-8172-48742c1ebc7a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:30.397919 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bab641-5c2b-413a-8172-48742c1ebc7a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:30.398390 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bab641-5c2b-413a-8172-48742c1ebc7a None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:30.399251 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bab641-5c2b-413a-8172-48742c1ebc7a None admin] RBAC: Adding query filter params (name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:30.399769 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bab641-5c2b-413a-8172-48742c1ebc7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:30.401388 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bab641-5c2b-413a-8172-48742c1ebc7a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:30.410539 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 280/545] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 22 20:26:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:30.417770 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a069818-504a-488d-a31a-4e009499bb51 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:30.518246 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0be88-7064-48ef-a582-124601cab51c None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:30.518846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0be88-7064-48ef-a582-124601cab51c None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:30.519331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0be88-7064-48ef-a582-124601cab51c None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:30.525016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 281/546] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:30.531060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68712487-0018-44b0-8100-0126cf6a46c7 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:30.531563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68712487-0018-44b0-8100-0126cf6a46c7 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:30.531843 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68712487-0018-44b0-8100-0126cf6a46c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:30.559460 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-68712487-0018-44b0-8100-0126cf6a46c7 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:30.561732 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-68712487-0018-44b0-8100-0126cf6a46c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:30.567102 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:30.577215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a069818-504a-488d-a31a-4e009499bb51 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:30.638656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2848066-b18e-405b-99a1-3197d6d4bc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:30.639290 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2848066-b18e-405b-99a1-3197d6d4bc96 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:30.639564 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2848066-b18e-405b-99a1-3197d6d4bc96 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:30.639829 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2848066-b18e-405b-99a1-3197d6d4bc96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:30.657829 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2848066-b18e-405b-99a1-3197d6d4bc96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:30.659312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2848066-b18e-405b-99a1-3197d6d4bc96 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:30.680157 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-f2848066-b18e-405b-99a1-3197d6d4bc96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:30.680157 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:30.680157 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:30.680157 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:30.680157 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:30.680157 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:30.680157 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:30.680157 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:30.680157 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:30.680157 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:30.680157 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:30.680157 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:30.680157 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:30.680157 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:30.680157 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:30.680157 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:30.681165 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:30.681165 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:30.681165 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:30.681165 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:30.681165 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:30.681165 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:30.681165 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:30.681165 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:30.681165 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:30.681165 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:30.681165 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:30.681165 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:30.681165 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:30.681165 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:30.681165 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:30.681165 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:30.681165 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:30.682077 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:30.682077 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:30.682077 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:30.682077 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 266/547] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:30.687690 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2848066-b18e-405b-99a1-3197d6d4bc96 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:30.690206 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 282/548] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:30.809195 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2848066-b18e-405b-99a1-3197d6d4bc96 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:30.844808 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9731715-1e83-47d6-9e8c-209ee39bc95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:30.845425 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9731715-1e83-47d6-9e8c-209ee39bc95b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:30.845942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9731715-1e83-47d6-9e8c-209ee39bc95b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:30.845942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9731715-1e83-47d6-9e8c-209ee39bc95b None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:30.846597 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9731715-1e83-47d6-9e8c-209ee39bc95b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:30.846964 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9731715-1e83-47d6-9e8c-209ee39bc95b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:30.848592 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9731715-1e83-47d6-9e8c-209ee39bc95b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:30.866420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 267/549] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:26:30.872054 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68712487-0018-44b0-8100-0126cf6a46c7 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:30.902191 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:31.038422 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68712487-0018-44b0-8100-0126cf6a46c7 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:31.075971 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a80c3-23f3-4d5f-8166-1849ef405041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:31.076522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a80c3-23f3-4d5f-8166-1849ef405041 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:31.076841 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a80c3-23f3-4d5f-8166-1849ef405041 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:31.077116 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a80c3-23f3-4d5f-8166-1849ef405041 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:31.085170 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a80c3-23f3-4d5f-8166-1849ef405041 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:31.086621 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a80c3-23f3-4d5f-8166-1849ef405041 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:31.098721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-b82a80c3-23f3-4d5f-8166-1849ef405041 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 20:26:31.098721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:31.098721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:31.098721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:31.098721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:31.098721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:31.098721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:31.098721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:31.098721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:31.098721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:31.098721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:31.098721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:31.098721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:26:31.098721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:26:31.098721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:26:31.098721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:26:31.099703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:31.099703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:31.099703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:26:31.099703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:31.099703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:26:31.099703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:31.099703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:31.099703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:31.099703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:31.099703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:31.099703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:31.099703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:31.099703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:31.099703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:31.099703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:31.099703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:31.099703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:31.099703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:31.100602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:31.100602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:31.100602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:26:31.100602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:26:31.100602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:26:31.100602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:26:31.100602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:26:31.100602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:26:31.100602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 20:26:31.100602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:31.100602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 283/550] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 22 20:26:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:31.105757 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9731715-1e83-47d6-9e8c-209ee39bc95b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:31.133096 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:31.144415 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a80c3-23f3-4d5f-8166-1849ef405041 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:31.281605 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:31.307387 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9731715-1e83-47d6-9e8c-209ee39bc95b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:31.329598 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a80c3-23f3-4d5f-8166-1849ef405041 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:31.379988 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55e689-6571-45b2-b967-93c0ea422595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:31.380599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55e689-6571-45b2-b967-93c0ea422595 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:31.380901 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55e689-6571-45b2-b967-93c0ea422595 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:31.381169 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55e689-6571-45b2-b967-93c0ea422595 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:31.384830 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55e689-6571-45b2-b967-93c0ea422595 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:31.385145 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55e689-6571-45b2-b967-93c0ea422595 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:31.387974 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55e689-6571-45b2-b967-93c0ea422595 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:31.404319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2ddc8-b82a-47e7-93f0-d3e203021a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:31.404982 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2ddc8-b82a-47e7-93f0-d3e203021a30 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:31.405249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2ddc8-b82a-47e7-93f0-d3e203021a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:31.405518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2ddc8-b82a-47e7-93f0-d3e203021a30 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:31.424493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2ddc8-b82a-47e7-93f0-d3e203021a30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:31.429961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 268/551] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Aug 22 20:26:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:31.435118 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-eff2ddc8-b82a-47e7-93f0-d3e203021a30 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:26:31.435118 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:31.435118 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:31.435118 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:31.435118 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:31.435118 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:31.435118 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:31.435118 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:31.435118 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:31.435118 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:31.435118 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:31.435118 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:31.435118 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:31.435118 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:31.435118 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:31.435118 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:31.437303 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:31.437303 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:31.437303 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:31.437303 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:31.437303 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:31.437303 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:31.437303 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:31.437303 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:31.437303 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:31.437303 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:31.437303 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:31.437303 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:31.437303 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:31.437303 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:31.437303 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:31.437303 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:31.439211 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:31.439211 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:31.439211 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:31.439211 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:31.439211 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:31.439211 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:31.439211 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:31.439211 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:31.439211 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:31.439211 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:31.439211 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:26:31.439211 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:31.444752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55e689-6571-45b2-b967-93c0ea422595 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:31.444951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 284/552] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 22 20:26:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:26:31.445632 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2ddc8-b82a-47e7-93f0-d3e203021a30 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:31.517760 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:31.559619 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55e689-6571-45b2-b967-93c0ea422595 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:31.565336 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2ddc8-b82a-47e7-93f0-d3e203021a30 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:31.596057 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c3775-5815-4dc7-b119-9319cea5b963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:31.596590 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c3775-5815-4dc7-b119-9319cea5b963 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:31.596932 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c3775-5815-4dc7-b119-9319cea5b963 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:31.597206 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c3775-5815-4dc7-b119-9319cea5b963 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:31.606815 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84132cd0-a2dd-4961-8d58-4ee169bf0084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:31.607636 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84132cd0-a2dd-4961-8d58-4ee169bf0084 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:31.608061 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84132cd0-a2dd-4961-8d58-4ee169bf0084 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:31.608603 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84132cd0-a2dd-4961-8d58-4ee169bf0084 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:31.610101 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84132cd0-a2dd-4961-8d58-4ee169bf0084 None admin] RBAC: Adding query filter params (name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:31.610863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84132cd0-a2dd-4961-8d58-4ee169bf0084 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:31.614354 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84132cd0-a2dd-4961-8d58-4ee169bf0084 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:31.623724 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:31.626216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 285/553] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 22 20:26:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:31.627781 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd705d1-6384-4b2d-8cbd-c5d76360c570 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:31.628317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd705d1-6384-4b2d-8cbd-c5d76360c570 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:31.628830 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd705d1-6384-4b2d-8cbd-c5d76360c570 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:31.635098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 286/554] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:31.636046 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd705d1-6384-4b2d-8cbd-c5d76360c570 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:31.673835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c3775-5815-4dc7-b119-9319cea5b963 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:31.675287 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c3775-5815-4dc7-b119-9319cea5b963 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:31.746476 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:31.758679 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd705d1-6384-4b2d-8cbd-c5d76360c570 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:31.793052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 269/555] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:26:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:26:31.795094 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb70875-7579-4eed-93e4-1fe21ffdce05 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:31.795383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb70875-7579-4eed-93e4-1fe21ffdce05 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:31.795908 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb70875-7579-4eed-93e4-1fe21ffdce05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:31.796235 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eefffca-0f8a-4f90-a4ff-82c80e749f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:31.796883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefffca-0f8a-4f90-a4ff-82c80e749f9b None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:31.797160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefffca-0f8a-4f90-a4ff-82c80e749f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:31.797430 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eefffca-0f8a-4f90-a4ff-82c80e749f9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:31.810067 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eefffca-0f8a-4f90-a4ff-82c80e749f9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:31.811517 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eefffca-0f8a-4f90-a4ff-82c80e749f9b None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:31.820079 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-eeb70875-7579-4eed-93e4-1fe21ffdce05 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:31.821721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-eeb70875-7579-4eed-93e4-1fe21ffdce05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:31.826809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-1eefffca-0f8a-4f90-a4ff-82c80e749f9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:31.826809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:31.826809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:31.826809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:31.826809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:31.826809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:31.826809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:31.826809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:31.826809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:31.826809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:31.826809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:31.826809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:31.826809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:31.826809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:31.826809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:31.826809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:31.828013 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:31.828013 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:31.828013 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:31.828013 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:31.828013 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:31.828013 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:31.828013 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:31.828013 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:31.828013 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:31.828013 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:31.828013 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:31.828013 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:31.828013 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:31.828013 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:31.828013 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:31.828013 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:31.828013 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:31.834542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:31.834542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:31.834542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:31.834542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 287/556] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:31.834542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021c6bc-958b-4ffa-b3ba-2f3f6459be6a None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:31.834542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021c6bc-958b-4ffa-b3ba-2f3f6459be6a None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:31.834542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021c6bc-958b-4ffa-b3ba-2f3f6459be6a None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:31.834542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 288/557] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:31.834542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021c6bc-958b-4ffa-b3ba-2f3f6459be6a None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:31.890126 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:31.901982 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 270/558] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:31.902725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb70875-7579-4eed-93e4-1fe21ffdce05 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:31.974609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021c6bc-958b-4ffa-b3ba-2f3f6459be6a None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:32.006630 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:32.012949 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb70875-7579-4eed-93e4-1fe21ffdce05 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:32.023237 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5f695-fe69-4e9c-b6cf-1958194a68b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:32.024523 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5f695-fe69-4e9c-b6cf-1958194a68b2 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:32.025311 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5f695-fe69-4e9c-b6cf-1958194a68b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:32.025742 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5f695-fe69-4e9c-b6cf-1958194a68b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:32.040796 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5f695-fe69-4e9c-b6cf-1958194a68b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:32.042299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5f695-fe69-4e9c-b6cf-1958194a68b2 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:32.058246 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faccfedf-484b-40af-948d-bc572df2547c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:32.059150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faccfedf-484b-40af-948d-bc572df2547c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:32.059573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faccfedf-484b-40af-948d-bc572df2547c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:32.060017 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faccfedf-484b-40af-948d-bc572df2547c None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:32.060845 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faccfedf-484b-40af-948d-bc572df2547c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:32.061292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faccfedf-484b-40af-948d-bc572df2547c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:32.062012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-8ad5f695-fe69-4e9c-b6cf-1958194a68b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:32.062012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:32.062012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:32.062012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:32.062012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:32.062012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:32.062012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:32.062012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:32.062012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:32.062012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:32.062012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:32.062012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:32.062012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:32.062012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:32.062012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:32.062012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:32.063199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:32.063199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:32.063199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:32.063199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:32.063199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:32.063199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:32.063199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:32.063199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:32.063199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:32.063199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:32.063199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:32.063199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:32.063199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:32.063199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:32.063199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:32.063199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:32.063199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:32.064097 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:32.064097 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:32.064097 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:32.064097 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 289/559] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:32.064639 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be284c0-efa3-48f2-9d53-363036c30abb None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:32.064944 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be284c0-efa3-48f2-9d53-363036c30abb None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:32.065263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be284c0-efa3-48f2-9d53-363036c30abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:32.066190 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faccfedf-484b-40af-948d-bc572df2547c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:32.087067 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 271/560] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:32.087067 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faccfedf-484b-40af-948d-bc572df2547c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:32.087674 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-1be284c0-efa3-48f2-9d53-363036c30abb None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:32.088963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-1be284c0-efa3-48f2-9d53-363036c30abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:32.189515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 290/561] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:32.190677 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be284c0-efa3-48f2-9d53-363036c30abb None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:32.205002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faccfedf-484b-40af-948d-bc572df2547c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:32.230895 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:32.242427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02abff2-adc9-4837-b159-d2a1b2ac803a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:32.243192 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02abff2-adc9-4837-b159-d2a1b2ac803a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:32.243533 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02abff2-adc9-4837-b159-d2a1b2ac803a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:32.243879 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02abff2-adc9-4837-b159-d2a1b2ac803a None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:32.244856 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02abff2-adc9-4837-b159-d2a1b2ac803a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:32.245203 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02abff2-adc9-4837-b159-d2a1b2ac803a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:32.247666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02abff2-adc9-4837-b159-d2a1b2ac803a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:32.260337 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 272/562] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:32.261406 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02abff2-adc9-4837-b159-d2a1b2ac803a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:32.280120 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:32.311974 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be284c0-efa3-48f2-9d53-363036c30abb None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:32.352436 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3cd4cd-7707-4513-9e58-8e605e50a31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:32.353497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cd4cd-7707-4513-9e58-8e605e50a31d None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:32.354028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cd4cd-7707-4513-9e58-8e605e50a31d None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:32.354534 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cd4cd-7707-4513-9e58-8e605e50a31d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:32.362806 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3cd4cd-7707-4513-9e58-8e605e50a31d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:32.365348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3cd4cd-7707-4513-9e58-8e605e50a31d None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:32.369490 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02abff2-adc9-4837-b159-d2a1b2ac803a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:32.378172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-9f3cd4cd-7707-4513-9e58-8e605e50a31d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:26:32.378172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:32.378172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:32.378172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:32.378172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:32.378172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:32.378172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:32.378172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:32.378172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:32.378172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:32.378172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:32.378172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:32.378172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:26:32.378172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:26:32.378172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:26:32.378172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:26:32.379223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:32.379223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:32.379223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:26:32.379223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:32.379223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:26:32.379223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:32.379223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:32.379223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:32.379223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:32.379223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:32.379223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:32.379223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:32.379223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:32.379223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:32.379223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:32.379223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:32.379223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:32.379223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:32.381047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:32.381047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:32.381047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:26:32.381047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:26:32.381047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:26:32.381047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:26:32.381047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:26:32.381047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:26:32.381047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:26:32.381047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:32.388188 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 291/563] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Aug 22 20:26:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:32.389339 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3cd4cd-7707-4513-9e58-8e605e50a31d None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:32.406032 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ad861-7bff-4b08-9a29-0a85b6d53b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:32.406654 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ad861-7bff-4b08-9a29-0a85b6d53b73 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:32.406929 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ad861-7bff-4b08-9a29-0a85b6d53b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:32.407214 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ad861-7bff-4b08-9a29-0a85b6d53b73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:32.417868 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2ad861-7bff-4b08-9a29-0a85b6d53b73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:32.422544 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-2e2ad861-7bff-4b08-9a29-0a85b6d53b73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:26:32.422544 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:32.422544 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:32.422544 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:32.422544 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:32.422544 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:32.422544 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:32.422544 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:32.422544 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:32.422544 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:32.422544 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:32.422544 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:32.422544 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:32.422544 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:32.422544 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:32.422544 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:32.425362 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:32.425362 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:32.425362 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:32.425362 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:32.425362 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:32.425362 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:32.425362 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:32.425362 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:32.425362 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:32.425362 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:32.425362 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:32.425362 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:32.425362 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:32.425362 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:32.425362 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:32.425362 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:32.429553 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:32.429553 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:32.429553 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:32.429553 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:32.429553 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:32.429553 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:32.429553 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:32.429553 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:32.429553 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:32.429553 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:32.429553 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:26:32.429553 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:32.429553 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 273/564] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 22 20:26:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:32.429553 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ad861-7bff-4b08-9a29-0a85b6d53b73 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:32.486488 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:32.496186 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3cd4cd-7707-4513-9e58-8e605e50a31d None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:32.510821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:32.530761 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f4e9d-861d-4e87-88af-26314085b5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:32.531384 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f4e9d-861d-4e87-88af-26314085b5cc None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:32.531656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f4e9d-861d-4e87-88af-26314085b5cc None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:32.531920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f4e9d-861d-4e87-88af-26314085b5cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:32.533465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ad861-7bff-4b08-9a29-0a85b6d53b73 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:32.539368 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f4e9d-861d-4e87-88af-26314085b5cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:32.540853 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f4e9d-861d-4e87-88af-26314085b5cc None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:32.552541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-987f4e9d-861d-4e87-88af-26314085b5cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:32.552541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:32.552541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:32.552541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:32.552541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:32.552541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:32.552541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:32.552541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:32.552541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:32.552541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:32.552541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:32.552541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:32.552541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:26:32.552541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:26:32.552541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:26:32.553640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:26:32.553640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:32.553640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:32.553640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:32.553640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:32.553640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:32.553640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:32.553640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:32.553640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:32.553640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:32.553640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:32.553640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:32.553640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:32.553640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:32.553640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:32.553640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:32.553640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:32.554697 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:26:32.554697 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:26:32.554697 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:26:32.554697 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:26:32.554697 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:26:32.554697 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:26:32.554697 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:32.554697 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:32.554697 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 292/565] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:26:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:32.555295 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e58b06-74d0-46a6-b030-816688c740d9 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:32.555375 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e58b06-74d0-46a6-b030-816688c740d9 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:32.555610 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e58b06-74d0-46a6-b030-816688c740d9 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:32.556845 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 293/566] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:32.557529 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e58b06-74d0-46a6-b030-816688c740d9 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:32.572396 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b36d0-9f66-43f2-9010-fb5c1bf91698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:32.573338 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b36d0-9f66-43f2-9010-fb5c1bf91698 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:32.573660 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b36d0-9f66-43f2-9010-fb5c1bf91698 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:32.573942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b36d0-9f66-43f2-9010-fb5c1bf91698 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:32.574684 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b36d0-9f66-43f2-9010-fb5c1bf91698 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:32.574993 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b36d0-9f66-43f2-9010-fb5c1bf91698 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:32.576432 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b36d0-9f66-43f2-9010-fb5c1bf91698 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:32.593966 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 274/567] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Aug 22 20:26:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:32.594769 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b36d0-9f66-43f2-9010-fb5c1bf91698 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:32.672985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e58b06-74d0-46a6-b030-816688c740d9 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:32.705489 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b36d0-9f66-43f2-9010-fb5c1bf91698 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:32.706816 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b061bb8-4fb3-41b7-b364-bc2cb34c682b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:32.707550 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b061bb8-4fb3-41b7-b364-bc2cb34c682b None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:32.707964 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b061bb8-4fb3-41b7-b364-bc2cb34c682b None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:32.708241 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b061bb8-4fb3-41b7-b364-bc2cb34c682b None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:32.708945 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b061bb8-4fb3-41b7-b364-bc2cb34c682b None admin] RBAC: Adding query filter params (name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:32.709248 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b061bb8-4fb3-41b7-b364-bc2cb34c682b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:32.710657 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b061bb8-4fb3-41b7-b364-bc2cb34c682b None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:32.718394 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 294/568] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 22 20:26:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:32.719175 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b061bb8-4fb3-41b7-b364-bc2cb34c682b None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:32.735509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:32.741059 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24083b98-d048-40ad-82ed-134b2ce1ed51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:32.741613 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24083b98-d048-40ad-82ed-134b2ce1ed51 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:32.741888 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24083b98-d048-40ad-82ed-134b2ce1ed51 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:32.742155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24083b98-d048-40ad-82ed-134b2ce1ed51 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:32.743980 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:32.752818 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24083b98-d048-40ad-82ed-134b2ce1ed51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:32.757525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-24083b98-d048-40ad-82ed-134b2ce1ed51 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:26:32.757525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:32.757525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:32.757525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:32.757525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:32.757525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:32.757525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:32.757525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:32.757525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:32.757525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:32.757525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:32.757525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:32.757525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:32.757525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:32.757525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:32.757525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:32.758608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:32.758608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:32.758608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:32.758608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:32.758608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:32.758608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:32.758608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:32.758608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:32.758608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:32.758608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:32.758608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:32.758608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:32.758608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:32.758608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:32.758608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:32.758608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:32.759581 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:32.759581 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:32.759581 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:32.759581 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:32.759581 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:32.759581 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:32.759581 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:32.759581 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:32.759581 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:32.759581 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:32.759581 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:26:32.759581 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:32.759581 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 275/569] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 22 20:26:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:32.760957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f32bde-20c4-4b73-9a62-884e9b6f256b None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:32.761241 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f32bde-20c4-4b73-9a62-884e9b6f256b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:32.761512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f32bde-20c4-4b73-9a62-884e9b6f256b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:32.777841 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-18f32bde-20c4-4b73-9a62-884e9b6f256b None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:32.779035 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-18f32bde-20c4-4b73-9a62-884e9b6f256b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:32.823204 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b061bb8-4fb3-41b7-b364-bc2cb34c682b None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:32.850997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 276/570] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:32.851835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f32bde-20c4-4b73-9a62-884e9b6f256b None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:32.872459 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60261336-4732-4f31-a0e9-5bff90a95eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:32.873089 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60261336-4732-4f31-a0e9-5bff90a95eba None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:32.873797 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60261336-4732-4f31-a0e9-5bff90a95eba None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:32.874074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60261336-4732-4f31-a0e9-5bff90a95eba None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:32.874763 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60261336-4732-4f31-a0e9-5bff90a95eba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:32.875069 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60261336-4732-4f31-a0e9-5bff90a95eba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:32.876499 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60261336-4732-4f31-a0e9-5bff90a95eba None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:32.887973 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 295/571] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 22 20:26:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:32.888799 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60261336-4732-4f31-a0e9-5bff90a95eba None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:32.956976 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f32bde-20c4-4b73-9a62-884e9b6f256b None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:32.962940 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:32.985461 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:32.996615 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60261336-4732-4f31-a0e9-5bff90a95eba None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:32.997769 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4a454-4f28-40e2-aa17-e01f7a746505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:32.998629 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4a454-4f28-40e2-aa17-e01f7a746505 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:32.999012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4a454-4f28-40e2-aa17-e01f7a746505 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:32.999331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4a454-4f28-40e2-aa17-e01f7a746505 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:33.010776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4a454-4f28-40e2-aa17-e01f7a746505 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:33.012496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4a454-4f28-40e2-aa17-e01f7a746505 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:33.029726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-43e4a454-4f28-40e2-aa17-e01f7a746505 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:33.029726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:33.029726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:33.029726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:33.029726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:33.029726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:33.029726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:33.029726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:33.029726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:33.029726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:33.029726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:33.029726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:33.029726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:33.029726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:33.029726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:33.029726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:33.030660 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:33.030660 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:33.030660 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:33.030660 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:33.030660 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:33.030660 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:33.030660 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:33.030660 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:33.030660 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:33.030660 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:33.030660 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:33.030660 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:33.030660 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:33.030660 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:33.030660 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:33.030660 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:33.030660 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:33.031522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:33.031522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:33.031522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:33.031522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 277/572] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:33.031522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4a454-4f28-40e2-aa17-e01f7a746505 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:33.036988 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42967445-e3ee-4a56-948b-7eee00d3b729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:33.037618 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42967445-e3ee-4a56-948b-7eee00d3b729 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:33.037895 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42967445-e3ee-4a56-948b-7eee00d3b729 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:33.038225 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42967445-e3ee-4a56-948b-7eee00d3b729 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:33.052848 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42967445-e3ee-4a56-948b-7eee00d3b729 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:33.055172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42967445-e3ee-4a56-948b-7eee00d3b729 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:33.070560 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-42967445-e3ee-4a56-948b-7eee00d3b729 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:33.070560 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:33.070560 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:33.070560 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:33.070560 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:33.070560 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:33.070560 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:33.070560 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:33.070560 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:33.070560 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:33.070560 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:33.070560 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:33.070560 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:33.070560 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:33.070560 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:33.070560 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:33.071483 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:33.071483 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:33.071483 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:33.071483 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:33.071483 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:33.071483 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:33.071483 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:33.071483 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:33.071483 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:33.071483 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:33.071483 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:33.071483 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:33.071483 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:33.071483 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:33.071483 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:33.071483 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:33.071483 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:33.072374 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:33.072374 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:33.072374 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:33.072374 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 296/573] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:33.072374 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42967445-e3ee-4a56-948b-7eee00d3b729 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:33.142624 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4a454-4f28-40e2-aa17-e01f7a746505 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:33.175392 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42967445-e3ee-4a56-948b-7eee00d3b729 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:33.177504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6080fad-0e49-4e64-97d6-c7438e7da68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:33.178106 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6080fad-0e49-4e64-97d6-c7438e7da68b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:33.178382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6080fad-0e49-4e64-97d6-c7438e7da68b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:33.178650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6080fad-0e49-4e64-97d6-c7438e7da68b None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:33.179308 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6080fad-0e49-4e64-97d6-c7438e7da68b None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:33.179606 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6080fad-0e49-4e64-97d6-c7438e7da68b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:33.181016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6080fad-0e49-4e64-97d6-c7438e7da68b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:33.188849 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 278/574] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 22 20:26:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:33.189636 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6080fad-0e49-4e64-97d6-c7438e7da68b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:33.198385 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:33.210865 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff6c25-4d9d-4cba-9571-da38f284877f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:33.211537 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff6c25-4d9d-4cba-9571-da38f284877f None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:33.211732 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff6c25-4d9d-4cba-9571-da38f284877f None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:33.212002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff6c25-4d9d-4cba-9571-da38f284877f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:33.212743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff6c25-4d9d-4cba-9571-da38f284877f None admin] RBAC: Adding query filter params (role.id=38bb7e6ed5854439aeaf5996eb6892f6, scope.project.id=783c362712d34405ab827e3f00a67995, user.id=907607fd209b416ba9b68512772c1d17) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:33.213050 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff6c25-4d9d-4cba-9571-da38f284877f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:33.214466 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff6c25-4d9d-4cba-9571-da38f284877f None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:33.219925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 297/575] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:26:33 2022] GET /identity/v3/role_assignments?user.id=907607fd209b416ba9b68512772c1d17&scope.project.id=783c362712d34405ab827e3f00a67995&role.id=38bb7e6ed5854439aeaf5996eb6892f6 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:33.220724 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff6c25-4d9d-4cba-9571-da38f284877f None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:33.235190 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:33.305362 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6080fad-0e49-4e64-97d6-c7438e7da68b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:33.340357 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff6c25-4d9d-4cba-9571-da38f284877f None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:33.344978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9b185-67be-4110-b029-99ed15aac282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:33.345599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9b185-67be-4110-b029-99ed15aac282 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:33.345877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9b185-67be-4110-b029-99ed15aac282 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:33.346145 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9b185-67be-4110-b029-99ed15aac282 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:33.346792 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9b185-67be-4110-b029-99ed15aac282 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:33.347090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9b185-67be-4110-b029-99ed15aac282 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:33.348974 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9b185-67be-4110-b029-99ed15aac282 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:33.362364 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 279/576] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:33.365545 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9b185-67be-4110-b029-99ed15aac282 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:33.381793 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57040469-5955-4f73-b024-6a8104c88245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:33.382400 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57040469-5955-4f73-b024-6a8104c88245 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:33.382676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57040469-5955-4f73-b024-6a8104c88245 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:33.382943 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57040469-5955-4f73-b024-6a8104c88245 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:33.383585 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57040469-5955-4f73-b024-6a8104c88245 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:33.383881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57040469-5955-4f73-b024-6a8104c88245 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:33.385274 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57040469-5955-4f73-b024-6a8104c88245 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:33.399111 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 298/577] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:33.400244 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57040469-5955-4f73-b024-6a8104c88245 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:33.455196 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:33.486265 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:33.490720 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9b185-67be-4110-b029-99ed15aac282 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:33.508038 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57040469-5955-4f73-b024-6a8104c88245 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:33.528477 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a6455-4499-4c5a-bb74-b5890602d966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:33.529311 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a6455-4499-4c5a-bb74-b5890602d966 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:33.529591 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a6455-4499-4c5a-bb74-b5890602d966 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:33.529863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a6455-4499-4c5a-bb74-b5890602d966 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:33.541782 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a6455-4499-4c5a-bb74-b5890602d966 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:33.543214 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b150452-2e7d-4c15-ba4c-81c9a645919a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:33.543843 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b150452-2e7d-4c15-ba4c-81c9a645919a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:33.544125 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b150452-2e7d-4c15-ba4c-81c9a645919a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:33.544401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b150452-2e7d-4c15-ba4c-81c9a645919a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:33.547085 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-a52a6455-4499-4c5a-bb74-b5890602d966 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:26:33.547085 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:33.547085 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:33.547085 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:33.547085 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:33.547085 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:33.547085 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:33.547085 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:33.547085 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:33.547085 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:33.547085 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:33.547085 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:33.547085 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:33.547085 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:33.547085 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:33.547085 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:33.548105 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:33.548105 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:33.548105 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:33.548105 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:33.548105 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:33.548105 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:33.548105 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:33.548105 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:33.548105 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:33.548105 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:33.548105 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:33.548105 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:33.548105 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:33.548105 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:33.548105 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:33.548105 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:33.549285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:33.549285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:33.549285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:33.549285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:33.549285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:33.549285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:33.549285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:33.549285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:33.549285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:33.549285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:33.549285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:26:33.549285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:33.549285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 280/578] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 22 20:26:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:33.549285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a6455-4499-4c5a-bb74-b5890602d966 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:33.561936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b150452-2e7d-4c15-ba4c-81c9a645919a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:33.563331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b150452-2e7d-4c15-ba4c-81c9a645919a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:33.578253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-4b150452-2e7d-4c15-ba4c-81c9a645919a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:33.578253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:33.578253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:33.578253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:33.578253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:33.578253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:33.578253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:33.578253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:33.578253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:33.578253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:33.578253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:33.578253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:33.578253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:33.578253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:33.578253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:33.578253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:33.584465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:33.584465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:33.584465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:33.584465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:33.584465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:33.584465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:33.584465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:33.584465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:33.584465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:33.584465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:33.584465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:33.584465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:33.584465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:33.584465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:33.584465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:33.584465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:33.584465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:33.585397 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:33.585397 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:33.585397 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:33.585397 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 299/579] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:33.585397 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b150452-2e7d-4c15-ba4c-81c9a645919a None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:33.679554 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a6455-4499-4c5a-bb74-b5890602d966 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:33.709076 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:33.712912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b150452-2e7d-4c15-ba4c-81c9a645919a None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:33.721129 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c69c97-cdd7-4648-9844-d745bf1a2960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:33.721761 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c69c97-cdd7-4648-9844-d745bf1a2960 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:33.722038 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c69c97-cdd7-4648-9844-d745bf1a2960 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:33.722310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c69c97-cdd7-4648-9844-d745bf1a2960 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:33.730739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c69c97-cdd7-4648-9844-d745bf1a2960 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:33.732721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c69c97-cdd7-4648-9844-d745bf1a2960 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:33.747083 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-79c69c97-cdd7-4648-9844-d745bf1a2960 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:33.747083 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:33.747083 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:33.747083 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:33.747083 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:33.747083 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:33.747083 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:33.747083 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:33.747083 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:33.747083 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:33.747083 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:33.747083 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:33.747083 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:26:33.747083 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:26:33.747083 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:26:33.747963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:26:33.747963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:33.747963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:33.747963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:33.747963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:33.747963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:33.747963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:33.747963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:33.747963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:33.747963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:33.747963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:33.747963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:33.747963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:33.747963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:33.747963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:33.747963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:33.747963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:33.748850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:26:33.748850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:26:33.748850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:26:33.748850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:26:33.748850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:26:33.748850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:26:33.748850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:33.748850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:33.748850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 281/580] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:26:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:33.752042 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f181a4-3050-433c-97d2-33ea5617a54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:33.752807 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f181a4-3050-433c-97d2-33ea5617a54f None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:33.752975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f181a4-3050-433c-97d2-33ea5617a54f None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:33.753226 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f181a4-3050-433c-97d2-33ea5617a54f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:33.753407 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c69c97-cdd7-4648-9844-d745bf1a2960 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:33.763578 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f181a4-3050-433c-97d2-33ea5617a54f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:33.765999 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f181a4-3050-433c-97d2-33ea5617a54f None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:33.775389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:33.780393 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-77f181a4-3050-433c-97d2-33ea5617a54f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 20:26:33.780393 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:33.780393 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:33.780393 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:33.780393 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:33.780393 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:33.780393 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:33.780393 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:33.780393 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:33.780393 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:33.780393 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:33.780393 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:33.780393 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:26:33.780393 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:26:33.780393 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:26:33.780393 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:26:33.782291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:33.782291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:33.782291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:26:33.782291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:33.782291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:26:33.782291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:33.782291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:33.782291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:33.782291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:33.782291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:33.782291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:33.782291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:33.782291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:33.782291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:33.782291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:33.782291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:33.782291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:33.782291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:33.783269 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:33.783269 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:33.783269 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:26:33.783269 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:26:33.783269 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:26:33.783269 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:26:33.783269 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:26:33.783269 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:26:33.783269 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 20:26:33.783269 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:33.783269 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 300/581] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:26:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:33.783269 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f181a4-3050-433c-97d2-33ea5617a54f None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:33.875184 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c69c97-cdd7-4648-9844-d745bf1a2960 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:33.891062 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f181a4-3050-433c-97d2-33ea5617a54f None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:33.913773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446a2a0-6e7c-47bc-84a1-5603d3792fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:33.914373 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446a2a0-6e7c-47bc-84a1-5603d3792fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:33.914650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446a2a0-6e7c-47bc-84a1-5603d3792fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:33.914923 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446a2a0-6e7c-47bc-84a1-5603d3792fc5 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:33.915577 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446a2a0-6e7c-47bc-84a1-5603d3792fc5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:33.915873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446a2a0-6e7c-47bc-84a1-5603d3792fc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:33.917261 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446a2a0-6e7c-47bc-84a1-5603d3792fc5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:33.929864 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 282/582] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 22 20:26:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:33.929864 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446a2a0-6e7c-47bc-84a1-5603d3792fc5 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:33.931832 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746168c-4a2a-4613-b7a8-5111f9fa1119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:33.932443 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746168c-4a2a-4613-b7a8-5111f9fa1119 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:33.932744 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746168c-4a2a-4613-b7a8-5111f9fa1119 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:33.933017 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746168c-4a2a-4613-b7a8-5111f9fa1119 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:33.933655 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4746168c-4a2a-4613-b7a8-5111f9fa1119 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:33.933953 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4746168c-4a2a-4613-b7a8-5111f9fa1119 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:33.935326 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4746168c-4a2a-4613-b7a8-5111f9fa1119 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:33.948583 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 301/583] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:33.949265 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746168c-4a2a-4613-b7a8-5111f9fa1119 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:33.971873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:34.017012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:34.037903 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446a2a0-6e7c-47bc-84a1-5603d3792fc5 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:34.054442 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746168c-4a2a-4613-b7a8-5111f9fa1119 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:34.072792 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00267d-a7b0-45fc-8778-54168abd776d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:34.073395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00267d-a7b0-45fc-8778-54168abd776d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:34.073673 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00267d-a7b0-45fc-8778-54168abd776d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:34.073940 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00267d-a7b0-45fc-8778-54168abd776d None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:34.074625 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00267d-a7b0-45fc-8778-54168abd776d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:34.075353 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00267d-a7b0-45fc-8778-54168abd776d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:34.076815 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00267d-a7b0-45fc-8778-54168abd776d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:34.094621 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 283/584] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 22 20:26:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:34.094796 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423f453-4507-4947-9a82-364719893696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:34.094796 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423f453-4507-4947-9a82-364719893696 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:34.094981 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00267d-a7b0-45fc-8778-54168abd776d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:34.095052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423f453-4507-4947-9a82-364719893696 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:34.095052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423f453-4507-4947-9a82-364719893696 None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:34.095052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423f453-4507-4947-9a82-364719893696 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:34.095052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423f453-4507-4947-9a82-364719893696 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:34.095052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423f453-4507-4947-9a82-364719893696 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:34.113208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 302/585] 10.222.0.62 () {56 vars in 1137 bytes} [Mon Aug 22 20:26:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:34.114317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423f453-4507-4947-9a82-364719893696 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:34.206019 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:34.211741 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00267d-a7b0-45fc-8778-54168abd776d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:34.234061 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423f453-4507-4947-9a82-364719893696 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:34.249572 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2c078-6715-46f6-a726-5e5efccc45aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:34.250212 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2c078-6715-46f6-a726-5e5efccc45aa None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:34.250493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2c078-6715-46f6-a726-5e5efccc45aa None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:34.250768 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2c078-6715-46f6-a726-5e5efccc45aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:34.260519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:34.263162 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2c078-6715-46f6-a726-5e5efccc45aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:34.264626 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2c078-6715-46f6-a726-5e5efccc45aa None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:34.279138 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467b0f9-1ad0-4f84-b7d9-3b50ddc786a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:34.280112 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467b0f9-1ad0-4f84-b7d9-3b50ddc786a1 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:34.280293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-45a2c078-6715-46f6-a726-5e5efccc45aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:34.280293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:34.280293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:34.280293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:34.280293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:34.280293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:34.280293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:34.280293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:34.280293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:34.280293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:34.280293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:34.280293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:34.280293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:34.280293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:34.280293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:34.280293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:34.281208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:34.281208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:34.281208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:34.281208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:34.281208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:34.281208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:34.281208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:34.281208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:34.281208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:34.281208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:34.281208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:34.281208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:34.281208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:34.281208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:34.281208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:34.281208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:34.281208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:34.287442 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:34.287442 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:34.287442 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:34.287613 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467b0f9-1ad0-4f84-b7d9-3b50ddc786a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:34.287613 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467b0f9-1ad0-4f84-b7d9-3b50ddc786a1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:34.287749 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 284/586] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:34.287749 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2c078-6715-46f6-a726-5e5efccc45aa None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:34.293782 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b467b0f9-1ad0-4f84-b7d9-3b50ddc786a1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:34.295277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b467b0f9-1ad0-4f84-b7d9-3b50ddc786a1 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:34.310182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-b467b0f9-1ad0-4f84-b7d9-3b50ddc786a1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 22 20:26:34.310182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:34.310182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:34.310182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:34.310182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:34.310182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:34.310182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:34.310182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:34.310182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:34.310182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:34.310182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:34.310182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:34.310182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:26:34.310182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:26:34.310182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:26:34.310182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:26:34.311192 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:34.311192 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:34.311192 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:26:34.311192 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:34.311192 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:26:34.311192 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:34.311192 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:34.311192 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:34.311192 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:34.311192 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:34.311192 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:34.311192 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:34.311192 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:34.311192 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:34.311192 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:34.311192 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:34.311192 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:34.311192 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:34.312109 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:34.312109 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:34.312109 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:26:34.312109 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:26:34.312109 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:26:34.312109 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:26:34.312109 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:26:34.312109 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:26:34.312109 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 22 20:26:34.312109 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:34.316257 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 303/587] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:26:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:34.317769 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467b0f9-1ad0-4f84-b7d9-3b50ddc786a1 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:34.403367 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2c078-6715-46f6-a726-5e5efccc45aa None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:34.427968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467b0f9-1ad0-4f84-b7d9-3b50ddc786a1 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:34.439759 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33769eb0-ad16-4299-8fc9-2d174b68597f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:34.440411 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33769eb0-ad16-4299-8fc9-2d174b68597f None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:34.440714 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33769eb0-ad16-4299-8fc9-2d174b68597f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:34.440989 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33769eb0-ad16-4299-8fc9-2d174b68597f None admin] PATH_INFO: `/v3/projects/783c362712d34405ab827e3f00a67995/users/9f1738f72b4848499cdf0ec6866c3c8f/roles/38bb7e6ed5854439aeaf5996eb6892f6` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:34.457217 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33769eb0-ad16-4299-8fc9-2d174b68597f None admin] RBAC: Authorizing `identity:create_grant(project_id=783c362712d34405ab827e3f00a67995, user_id=9f1738f72b4848499cdf0ec6866c3c8f, role_id=38bb7e6ed5854439aeaf5996eb6892f6)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:34.459276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33769eb0-ad16-4299-8fc9-2d174b68597f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:34.464344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32556a5f-8ff3-4040-82f4-39da141be0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:34.465111 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32556a5f-8ff3-4040-82f4-39da141be0ef None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:34.465455 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32556a5f-8ff3-4040-82f4-39da141be0ef None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:34.465790 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32556a5f-8ff3-4040-82f4-39da141be0ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:34.473030 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:34.476828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32556a5f-8ff3-4040-82f4-39da141be0ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:34.478387 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32556a5f-8ff3-4040-82f4-39da141be0ef None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:34.492215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-32556a5f-8ff3-4040-82f4-39da141be0ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:34.492215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:34.492215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:34.492215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:34.492215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:34.492215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:34.492215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:34.492215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:34.492215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:34.492215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:34.492215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:34.492215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:34.492215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:34.492215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:34.492215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:34.492215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:34.498199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:34.498199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:34.498199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:34.498199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:34.498199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:34.498199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:34.498199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:34.498199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:34.498199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:34.498199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:34.498199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:34.498199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:34.498199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:34.498199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:34.498199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:34.498199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:34.498199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:34.499362 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:34.499362 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:34.499362 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:34.499362 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 304/588] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:34.499362 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32556a5f-8ff3-4040-82f4-39da141be0ef None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:34.567420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 285/589] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 22 20:26:34 2022] PUT /identity/v3/projects/783c362712d34405ab827e3f00a67995/users/9f1738f72b4848499cdf0ec6866c3c8f/roles/38bb7e6ed5854439aeaf5996eb6892f6 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:26:34.567420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33769eb0-ad16-4299-8fc9-2d174b68597f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:34.611937 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32556a5f-8ff3-4040-82f4-39da141be0ef None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:34.634949 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:34.653934 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022ed33-31ef-4b6a-98d2-194c71600a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:34.654588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022ed33-31ef-4b6a-98d2-194c71600a6f None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:34.654872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022ed33-31ef-4b6a-98d2-194c71600a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:34.655139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022ed33-31ef-4b6a-98d2-194c71600a6f None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:34.655784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022ed33-31ef-4b6a-98d2-194c71600a6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:34.656081 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022ed33-31ef-4b6a-98d2-194c71600a6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:34.657575 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022ed33-31ef-4b6a-98d2-194c71600a6f None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:34.671803 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 305/590] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:34.672683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022ed33-31ef-4b6a-98d2-194c71600a6f None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:34.732710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33769eb0-ad16-4299-8fc9-2d174b68597f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:34.740036 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:34.790851 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317278a-f8d3-4bf6-8c9b-26948f1b47b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:34.791719 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317278a-f8d3-4bf6-8c9b-26948f1b47b3 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:34.792170 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317278a-f8d3-4bf6-8c9b-26948f1b47b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:34.792590 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317278a-f8d3-4bf6-8c9b-26948f1b47b3 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:34.793783 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317278a-f8d3-4bf6-8c9b-26948f1b47b3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:34.794386 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317278a-f8d3-4bf6-8c9b-26948f1b47b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:34.796122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317278a-f8d3-4bf6-8c9b-26948f1b47b3 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:34.799956 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022ed33-31ef-4b6a-98d2-194c71600a6f None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:34.821775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 286/591] 10.222.0.62 () {56 vars in 1137 bytes} [Mon Aug 22 20:26:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:34.822916 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317278a-f8d3-4bf6-8c9b-26948f1b47b3 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:34.836450 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61f6fe-fe4e-4881-b3e1-81eaf569c65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:34.837087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61f6fe-fe4e-4881-b3e1-81eaf569c65e None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:34.837388 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61f6fe-fe4e-4881-b3e1-81eaf569c65e None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:34.837864 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61f6fe-fe4e-4881-b3e1-81eaf569c65e None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:34.838375 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61f6fe-fe4e-4881-b3e1-81eaf569c65e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:34.838679 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61f6fe-fe4e-4881-b3e1-81eaf569c65e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:34.840038 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61f6fe-fe4e-4881-b3e1-81eaf569c65e None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:34.856983 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 306/592] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:34.857871 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61f6fe-fe4e-4881-b3e1-81eaf569c65e None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:34.932572 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:34.935653 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317278a-f8d3-4bf6-8c9b-26948f1b47b3 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:34.966321 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61f6fe-fe4e-4881-b3e1-81eaf569c65e None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:34.974658 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900f7fe-76fd-4846-8612-b4e10a2dc1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:34.975309 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900f7fe-76fd-4846-8612-b4e10a2dc1c9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:34.975941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900f7fe-76fd-4846-8612-b4e10a2dc1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:34.976534 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900f7fe-76fd-4846-8612-b4e10a2dc1c9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:34.979494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:34.986087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3900f7fe-76fd-4846-8612-b4e10a2dc1c9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:34.987907 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3900f7fe-76fd-4846-8612-b4e10a2dc1c9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:35.000802 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-3900f7fe-76fd-4846-8612-b4e10a2dc1c9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 20:26:35.000802 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:35.000802 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:35.000802 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:35.000802 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:35.000802 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:35.000802 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:35.000802 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:35.000802 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:35.000802 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:35.000802 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:35.000802 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:35.000802 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:26:35.000802 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:26:35.000802 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:26:35.000802 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:26:35.002147 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:35.002147 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:35.002147 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:26:35.002147 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:35.002147 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:26:35.002147 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:35.002147 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:35.002147 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:35.002147 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:35.002147 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:35.002147 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:35.002147 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:35.002147 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:35.002147 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:35.002147 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:35.002147 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:35.002147 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:35.002147 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:35.003329 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:35.003329 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:35.003329 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:26:35.003329 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:26:35.003329 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:26:35.003329 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:26:35.003329 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:26:35.003329 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:26:35.003329 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 20:26:35.003329 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:35.006629 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 287/593] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 22 20:26:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:35.008130 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900f7fe-76fd-4846-8612-b4e10a2dc1c9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:35.009657 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a53c2-0bd8-4a4b-bf89-102dbf7027a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:35.010817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a53c2-0bd8-4a4b-bf89-102dbf7027a7 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:35.011192 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a53c2-0bd8-4a4b-bf89-102dbf7027a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:35.011557 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a53c2-0bd8-4a4b-bf89-102dbf7027a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:35.024541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a53c2-0bd8-4a4b-bf89-102dbf7027a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:35.026145 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a53c2-0bd8-4a4b-bf89-102dbf7027a7 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:35.041892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-968a53c2-0bd8-4a4b-bf89-102dbf7027a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:35.041892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:35.041892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:35.041892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:35.041892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:35.041892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:35.041892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:35.041892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:35.041892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:35.041892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:35.041892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:35.041892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:35.041892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:35.041892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:35.041892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:35.041892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:35.042961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:35.042961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:35.042961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:35.042961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:35.042961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:35.042961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:35.042961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:35.042961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:35.042961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:35.042961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:35.042961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:35.042961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:35.042961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:35.042961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:35.042961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:35.042961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:35.042961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:35.044101 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:35.044101 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:35.044101 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:35.048459 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 307/594] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:35.049416 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a53c2-0bd8-4a4b-bf89-102dbf7027a7 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:35.131785 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900f7fe-76fd-4846-8612-b4e10a2dc1c9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:35.167609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a53c2-0bd8-4a4b-bf89-102dbf7027a7 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:35.171684 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e0f98-2d2c-420a-b8e3-ec3606b01de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:35.172310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e0f98-2d2c-420a-b8e3-ec3606b01de4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:35.172586 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e0f98-2d2c-420a-b8e3-ec3606b01de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:35.172896 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e0f98-2d2c-420a-b8e3-ec3606b01de4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:35.179683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e0f98-2d2c-420a-b8e3-ec3606b01de4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:35.181164 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e0f98-2d2c-420a-b8e3-ec3606b01de4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:35.192599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-9b4e0f98-2d2c-420a-b8e3-ec3606b01de4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:35.192599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:35.192599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:35.192599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:35.192599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:35.192599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:35.192599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:35.192599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:35.192599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:35.192599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:35.192599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:35.192599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:35.192599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:26:35.192599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:26:35.192599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:26:35.193779 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:26:35.193779 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:35.193779 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:35.193779 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:35.193779 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:35.193779 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:35.193779 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:35.193779 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:35.193779 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:35.193779 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:35.193779 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:35.193779 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:35.193779 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:35.193779 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:35.193779 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:35.193779 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:35.193779 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:35.194644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:26:35.194644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:26:35.194644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:26:35.194644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:26:35.194644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:26:35.194644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:26:35.194644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:35.194644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:35.194644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 288/595] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:26:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:35.195120 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e0f98-2d2c-420a-b8e3-ec3606b01de4 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:35.211523 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e54e8-d142-460c-a3ca-2f911a3602da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:35.212351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e54e8-d142-460c-a3ca-2f911a3602da None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:35.212462 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e54e8-d142-460c-a3ca-2f911a3602da None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:35.212640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e54e8-d142-460c-a3ca-2f911a3602da None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:35.213378 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e54e8-d142-460c-a3ca-2f911a3602da None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:35.213719 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e54e8-d142-460c-a3ca-2f911a3602da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:35.215152 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e54e8-d142-460c-a3ca-2f911a3602da None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:35.219614 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:35.236775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 308/596] 10.222.0.62 () {56 vars in 1139 bytes} [Mon Aug 22 20:26:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:35.236775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f485b14-4ecc-4b4f-aacc-67dc880a4486 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:35.236775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f485b14-4ecc-4b4f-aacc-67dc880a4486 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:35.236775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f485b14-4ecc-4b4f-aacc-67dc880a4486 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:35.236775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 309/597] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:35.236775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f485b14-4ecc-4b4f-aacc-67dc880a4486 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:35.259355 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:35.318720 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e0f98-2d2c-420a-b8e3-ec3606b01de4 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:35.338849 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f485b14-4ecc-4b4f-aacc-67dc880a4486 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:35.357896 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a5c10-5ab4-42d1-a4f5-3da90d1861c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:35.358737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a5c10-5ab4-42d1-a4f5-3da90d1861c4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:35.359178 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a5c10-5ab4-42d1-a4f5-3da90d1861c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:35.359719 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a5c10-5ab4-42d1-a4f5-3da90d1861c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:35.360362 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a5c10-5ab4-42d1-a4f5-3da90d1861c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:35.360684 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a5c10-5ab4-42d1-a4f5-3da90d1861c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:35.362065 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91a5c10-5ab4-42d1-a4f5-3da90d1861c4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:35.373296 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7532a-2869-48e4-ba70-c002ae72d9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:35.373890 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7532a-2869-48e4-ba70-c002ae72d9f9 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:35.374164 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7532a-2869-48e4-ba70-c002ae72d9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:35.374432 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7532a-2869-48e4-ba70-c002ae72d9f9 None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:35.375106 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7532a-2869-48e4-ba70-c002ae72d9f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:35.375402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7532a-2869-48e4-ba70-c002ae72d9f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:35.376491 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 289/598] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:35.376837 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7532a-2869-48e4-ba70-c002ae72d9f9 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:35.378022 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da506d0-0cac-4411-889d-f3044d86009a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:35.378545 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da506d0-0cac-4411-889d-f3044d86009a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:35.379051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da506d0-0cac-4411-889d-f3044d86009a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:35.391694 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 310/599] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 22 20:26:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:35.392700 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7532a-2869-48e4-ba70-c002ae72d9f9 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:35.401357 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-6da506d0-0cac-4411-889d-f3044d86009a None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:35.402735 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6da506d0-0cac-4411-889d-f3044d86009a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:35.476269 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 290/600] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:35.476984 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da506d0-0cac-4411-889d-f3044d86009a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:35.477225 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:35.488729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:35.502412 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7532a-2869-48e4-ba70-c002ae72d9f9 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:35.547214 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0280a17-19dc-490a-a942-ee358fee8986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:35.548949 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0280a17-19dc-490a-a942-ee358fee8986 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:35.549410 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0280a17-19dc-490a-a942-ee358fee8986 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:35.549858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0280a17-19dc-490a-a942-ee358fee8986 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:35.562652 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0280a17-19dc-490a-a942-ee358fee8986 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:35.565283 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0280a17-19dc-490a-a942-ee358fee8986 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:35.579117 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da506d0-0cac-4411-889d-f3044d86009a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:35.581524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-e0280a17-19dc-490a-a942-ee358fee8986 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:35.581524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:35.581524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:35.581524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:35.581524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:35.581524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:35.581524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:35.581524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:35.581524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:35.581524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:35.581524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:35.581524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:35.581524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:35.581524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:35.581524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:35.581524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:35.582942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:35.582942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:35.582942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:35.582942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:35.582942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:35.582942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:35.582942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:35.582942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:35.582942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:35.582942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:35.582942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:35.582942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:35.582942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:35.582942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:35.582942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:35.582942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:35.582942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:35.583819 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:35.583819 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:35.583819 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:35.590267 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 311/601] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:35.591399 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0280a17-19dc-490a-a942-ee358fee8986 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:35.616081 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb8e97-46a2-44df-ac79-ea9de982da92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:35.617109 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb8e97-46a2-44df-ac79-ea9de982da92 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:35.617223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb8e97-46a2-44df-ac79-ea9de982da92 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:35.617514 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb8e97-46a2-44df-ac79-ea9de982da92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:35.624906 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb8e97-46a2-44df-ac79-ea9de982da92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:35.626408 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb8e97-46a2-44df-ac79-ea9de982da92 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:35.637661 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-00fb8e97-46a2-44df-ac79-ea9de982da92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:35.637661 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:35.637661 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:35.637661 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:35.637661 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:35.637661 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:35.637661 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:35.637661 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:35.637661 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:35.637661 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:35.637661 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:35.637661 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:35.637661 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:26:35.637661 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:26:35.637661 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:26:35.638569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:26:35.638569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:35.638569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:35.638569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:35.638569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:35.638569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:35.638569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:35.638569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:35.638569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:35.638569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:35.638569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:35.638569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:35.638569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:35.638569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:35.638569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:35.638569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:35.638569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:35.639450 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:26:35.639450 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:26:35.639450 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:26:35.639450 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:26:35.639450 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:26:35.639450 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:26:35.639450 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:35.639450 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:35.639450 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 291/602] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:26:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:35.639931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb8e97-46a2-44df-ac79-ea9de982da92 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:35.710834 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0280a17-19dc-490a-a942-ee358fee8986 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:35.719497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:35.743489 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:35.749122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a795750-5cd4-4e9b-adbe-ae063ea5e507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:35.750076 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a795750-5cd4-4e9b-adbe-ae063ea5e507 None admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:35.750517 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a795750-5cd4-4e9b-adbe-ae063ea5e507 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:35.750940 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a795750-5cd4-4e9b-adbe-ae063ea5e507 None admin] PATH_INFO: `/v3/projects/783c362712d34405ab827e3f00a67995/users/893e204cfff74570b3226b2e8c47df57/roles/38bb7e6ed5854439aeaf5996eb6892f6` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:35.755175 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb8e97-46a2-44df-ac79-ea9de982da92 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:35.769216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a795750-5cd4-4e9b-adbe-ae063ea5e507 None admin] RBAC: Authorizing `identity:create_grant(project_id=783c362712d34405ab827e3f00a67995, user_id=893e204cfff74570b3226b2e8c47df57, role_id=38bb7e6ed5854439aeaf5996eb6892f6)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:35.771444 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a795750-5cd4-4e9b-adbe-ae063ea5e507 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:35.794389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0fa09-65d4-48fa-98ea-84674e91a3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:35.794389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0fa09-65d4-48fa-98ea-84674e91a3bd None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:35.794599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0fa09-65d4-48fa-98ea-84674e91a3bd None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:35.794870 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0fa09-65d4-48fa-98ea-84674e91a3bd None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:35.795505 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a0fa09-65d4-48fa-98ea-84674e91a3bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:35.795801 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a0fa09-65d4-48fa-98ea-84674e91a3bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:35.797374 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a0fa09-65d4-48fa-98ea-84674e91a3bd None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:35.813493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 292/603] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:35.813493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0fa09-65d4-48fa-98ea-84674e91a3bd None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:35.852697 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 312/604] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 22 20:26:35 2022] PUT /identity/v3/projects/783c362712d34405ab827e3f00a67995/users/893e204cfff74570b3226b2e8c47df57/roles/38bb7e6ed5854439aeaf5996eb6892f6 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:26:35.852697 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a795750-5cd4-4e9b-adbe-ae063ea5e507 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:35.938179 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0fa09-65d4-48fa-98ea-84674e91a3bd None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:35.971542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a795750-5cd4-4e9b-adbe-ae063ea5e507 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:35.979357 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:35.987223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c9478-9450-492a-8456-7a544c15d87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:35.988487 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c9478-9450-492a-8456-7a544c15d87a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:35.995256 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c9478-9450-492a-8456-7a544c15d87a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:35.995256 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c9478-9450-492a-8456-7a544c15d87a None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:35.995256 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c9478-9450-492a-8456-7a544c15d87a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:35.995256 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c9478-9450-492a-8456-7a544c15d87a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:35.995256 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c9478-9450-492a-8456-7a544c15d87a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:36.010099 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 293/605] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 22 20:26:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:36.010464 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c9478-9450-492a-8456-7a544c15d87a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:36.013353 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c33d5-7087-49b5-83d7-fbcfdbc41e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:36.014999 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c33d5-7087-49b5-83d7-fbcfdbc41e9a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:36.015383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c33d5-7087-49b5-83d7-fbcfdbc41e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:36.015753 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c33d5-7087-49b5-83d7-fbcfdbc41e9a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:36.033256 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c33d5-7087-49b5-83d7-fbcfdbc41e9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:36.040806 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-2b8c33d5-7087-49b5-83d7-fbcfdbc41e9a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:26:36.040806 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:36.040806 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:36.040806 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:36.040806 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:36.040806 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:36.040806 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:36.040806 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:36.040806 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:36.040806 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:36.040806 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:36.040806 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:36.040806 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:36.040806 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:36.040806 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:36.040806 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:36.041762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:36.041762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:36.041762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:36.041762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:36.041762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:36.041762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:36.041762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:36.041762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:36.041762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:36.041762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:36.041762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:36.041762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:36.041762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:36.041762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:36.041762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:36.041762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:36.042571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:36.042571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:36.042571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:36.042571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:36.042571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:36.042571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:36.042571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:36.042571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:36.042571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:36.042571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:36.042571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:26:36.042571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:36.042571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 313/606] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 22 20:26:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:36.043246 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c33d5-7087-49b5-83d7-fbcfdbc41e9a None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:36.101657 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:36.138450 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c9478-9450-492a-8456-7a544c15d87a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:36.178957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c33d5-7087-49b5-83d7-fbcfdbc41e9a None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:36.181160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1453818-54a4-4a27-89d7-13ca744de1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:36.181999 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1453818-54a4-4a27-89d7-13ca744de1ac None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:36.182386 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1453818-54a4-4a27-89d7-13ca744de1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:36.183394 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1453818-54a4-4a27-89d7-13ca744de1ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:36.190466 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1453818-54a4-4a27-89d7-13ca744de1ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:36.192212 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1453818-54a4-4a27-89d7-13ca744de1ac None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:36.205056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-c1453818-54a4-4a27-89d7-13ca744de1ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:36.205056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:36.205056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:36.205056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:36.205056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:36.205056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:36.205056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:36.205056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:36.205056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:36.205056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:36.205056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:36.205056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:36.205056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:26:36.205056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:26:36.205056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:26:36.205972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:26:36.205972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:36.205972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:36.205972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:36.205972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:36.205972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:36.205972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:36.205972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:36.205972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:36.205972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:36.205972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:36.205972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:36.205972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:36.205972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:36.205972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:36.205972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:36.205972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:36.207433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:26:36.207433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:26:36.207433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:26:36.207433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:26:36.207433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:26:36.207433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:26:36.207433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:36.207433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:36.207433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 294/607] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:26:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:36.212722 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1453818-54a4-4a27-89d7-13ca744de1ac None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:36.223172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0ad91-bcc9-4706-b11b-a84eca7101d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:36.224996 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0ad91-bcc9-4706-b11b-a84eca7101d7 None admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:36.225480 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0ad91-bcc9-4706-b11b-a84eca7101d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:36.226073 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0ad91-bcc9-4706-b11b-a84eca7101d7 None admin] PATH_INFO: `/v3/projects/783c362712d34405ab827e3f00a67995/users/d4e298bcbaf84866b4fc6c6f65216fc5/roles/38bb7e6ed5854439aeaf5996eb6892f6` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:36.243294 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0ad91-bcc9-4706-b11b-a84eca7101d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=783c362712d34405ab827e3f00a67995, user_id=d4e298bcbaf84866b4fc6c6f65216fc5, role_id=38bb7e6ed5854439aeaf5996eb6892f6)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:36.245110 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0ad91-bcc9-4706-b11b-a84eca7101d7 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:36.267246 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:36.318308 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1453818-54a4-4a27-89d7-13ca744de1ac None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:36.353402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 314/608] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 22 20:26:36 2022] PUT /identity/v3/projects/783c362712d34405ab827e3f00a67995/users/d4e298bcbaf84866b4fc6c6f65216fc5/roles/38bb7e6ed5854439aeaf5996eb6892f6 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:26:36.355236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0ad91-bcc9-4706-b11b-a84eca7101d7 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:36.368989 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc2952-659b-49fc-bbdb-ea7d90fe4554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:36.370541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc2952-659b-49fc-bbdb-ea7d90fe4554 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:36.371541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc2952-659b-49fc-bbdb-ea7d90fe4554 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:36.372517 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc2952-659b-49fc-bbdb-ea7d90fe4554 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:36.372517 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc2952-659b-49fc-bbdb-ea7d90fe4554 None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:36.372865 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc2952-659b-49fc-bbdb-ea7d90fe4554 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:36.375289 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cc2952-659b-49fc-bbdb-ea7d90fe4554 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:36.397824 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 295/609] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 22 20:26:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:36.400264 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc2952-659b-49fc-bbdb-ea7d90fe4554 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:36.526009 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc2952-659b-49fc-bbdb-ea7d90fe4554 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:36.539840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:36.563375 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ca19c-7252-4447-950a-c06c3f6d2d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:36.564012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ca19c-7252-4447-950a-c06c3f6d2d3d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:36.564461 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ca19c-7252-4447-950a-c06c3f6d2d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:36.564778 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ca19c-7252-4447-950a-c06c3f6d2d3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:36.579955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ca19c-7252-4447-950a-c06c3f6d2d3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:36.581004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:36.581686 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ca19c-7252-4447-950a-c06c3f6d2d3d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:36.589349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0ad91-bcc9-4706-b11b-a84eca7101d7 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:36.600850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-316ca19c-7252-4447-950a-c06c3f6d2d3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:36.600850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:36.600850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:36.600850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:36.600850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:36.600850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:36.600850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:36.600850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:36.600850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:36.600850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:36.600850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:36.600850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:36.600850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:36.600850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:36.600850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:36.600850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:36.601817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:36.601817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:36.601817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:36.601817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:36.601817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:36.601817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:36.601817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:36.601817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:36.601817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:36.601817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:36.601817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:36.601817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:36.601817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:36.601817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:36.601817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:36.601817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:36.601817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:36.602689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:36.602689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:36.602689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:36.602689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 296/610] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:36.608786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ca19c-7252-4447-950a-c06c3f6d2d3d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:36.637994 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13521be7-0299-4023-a6f9-c7606625ac7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:36.638652 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13521be7-0299-4023-a6f9-c7606625ac7a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:36.638996 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13521be7-0299-4023-a6f9-c7606625ac7a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:36.639266 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13521be7-0299-4023-a6f9-c7606625ac7a None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:36.640170 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13521be7-0299-4023-a6f9-c7606625ac7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:36.640475 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13521be7-0299-4023-a6f9-c7606625ac7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:36.642105 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13521be7-0299-4023-a6f9-c7606625ac7a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:36.656556 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 315/611] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 22 20:26:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:36.666488 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13521be7-0299-4023-a6f9-c7606625ac7a None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:36.744693 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ca19c-7252-4447-950a-c06c3f6d2d3d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:36.781142 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4076c8-0a80-42b0-82f0-3178e4709369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:36.781669 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4076c8-0a80-42b0-82f0-3178e4709369 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:36.781951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4076c8-0a80-42b0-82f0-3178e4709369 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:36.782224 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4076c8-0a80-42b0-82f0-3178e4709369 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:36.782718 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13521be7-0299-4023-a6f9-c7606625ac7a None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:36.782851 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4076c8-0a80-42b0-82f0-3178e4709369 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:36.783160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4076c8-0a80-42b0-82f0-3178e4709369 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:36.784644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4076c8-0a80-42b0-82f0-3178e4709369 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:36.798915 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 297/612] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:36.800422 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669d87b-ee09-4ead-95c2-4c1f1241d018 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:36.801516 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669d87b-ee09-4ead-95c2-4c1f1241d018 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:36.801919 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669d87b-ee09-4ead-95c2-4c1f1241d018 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:36.803890 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 298/613] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:36.816011 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669d87b-ee09-4ead-95c2-4c1f1241d018 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:36.843961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec160d4-f2dc-4c0e-9377-147b0d8abb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:36.845229 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec160d4-f2dc-4c0e-9377-147b0d8abb45 None admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:36.845512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec160d4-f2dc-4c0e-9377-147b0d8abb45 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:36.845787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec160d4-f2dc-4c0e-9377-147b0d8abb45 None admin] PATH_INFO: `/v3/projects/783c362712d34405ab827e3f00a67995/users/538ba8188ed540628242c983ebd6dd1f/roles/38bb7e6ed5854439aeaf5996eb6892f6` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:36.850115 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:36.868360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec160d4-f2dc-4c0e-9377-147b0d8abb45 None admin] RBAC: Authorizing `identity:create_grant(project_id=783c362712d34405ab827e3f00a67995, user_id=538ba8188ed540628242c983ebd6dd1f, role_id=38bb7e6ed5854439aeaf5996eb6892f6)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:36.872059 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec160d4-f2dc-4c0e-9377-147b0d8abb45 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:36.935622 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669d87b-ee09-4ead-95c2-4c1f1241d018 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:36.975438 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bee312-a5f3-436c-aa81-920b6aa47798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:36.976428 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bee312-a5f3-436c-aa81-920b6aa47798 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:36.977277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bee312-a5f3-436c-aa81-920b6aa47798 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:36.978205 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bee312-a5f3-436c-aa81-920b6aa47798 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:36.989190 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 316/614] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 22 20:26:36 2022] PUT /identity/v3/projects/783c362712d34405ab827e3f00a67995/users/538ba8188ed540628242c983ebd6dd1f/roles/38bb7e6ed5854439aeaf5996eb6892f6 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:26:36.990625 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bee312-a5f3-436c-aa81-920b6aa47798 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:36.990807 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c599fd-59e8-42f2-b9b4-25a86fc68aaf None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:36.991158 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c599fd-59e8-42f2-b9b4-25a86fc68aaf None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:36.991442 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c599fd-59e8-42f2-b9b4-25a86fc68aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:36.992965 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bee312-a5f3-436c-aa81-920b6aa47798 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:37.005211 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:37.014528 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-37bee312-a5f3-436c-aa81-920b6aa47798 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 20:26:37.014528 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:37.014528 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:37.014528 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:37.014528 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:37.014528 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:37.014528 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:37.014528 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:37.014528 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:37.014528 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:37.014528 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:37.014528 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:37.014528 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:26:37.014528 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:26:37.014528 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:26:37.014528 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:26:37.015776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:37.015776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:37.015776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:26:37.015776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:37.015776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:26:37.015776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:37.015776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:37.015776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:37.015776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:37.015776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:37.015776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:37.015776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:37.015776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:37.015776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:37.015776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:37.015776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:37.015776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:37.015776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:37.024744 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:37.024744 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:37.024744 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:26:37.024744 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:26:37.024744 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:26:37.024744 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:26:37.024744 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:26:37.024744 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:26:37.024744 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 20:26:37.024744 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:37.024744 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 299/615] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 22 20:26:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:26:37.027531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bee312-a5f3-436c-aa81-920b6aa47798 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:37.033583 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-e5c599fd-59e8-42f2-b9b4-25a86fc68aaf None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:37.034813 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-e5c599fd-59e8-42f2-b9b4-25a86fc68aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:37.189127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 317/616] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:37.203909 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:37.228205 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bee312-a5f3-436c-aa81-920b6aa47798 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:37.265172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef5082-53ae-4a1b-942e-5f0670daca3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:37.266062 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef5082-53ae-4a1b-942e-5f0670daca3e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:37.266491 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef5082-53ae-4a1b-942e-5f0670daca3e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:37.266970 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef5082-53ae-4a1b-942e-5f0670daca3e None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:37.267950 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef5082-53ae-4a1b-942e-5f0670daca3e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:37.268402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef5082-53ae-4a1b-942e-5f0670daca3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:37.270558 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef5082-53ae-4a1b-942e-5f0670daca3e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:37.289266 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 300/617] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Aug 22 20:26:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:37.297778 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c599fd-59e8-42f2-b9b4-25a86fc68aaf None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:37.438958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c599fd-59e8-42f2-b9b4-25a86fc68aaf None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:37.476338 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:37.483862 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b49dc4-1b6f-4edd-ba97-1f90ce2c396c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:37.490550 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b49dc4-1b6f-4edd-ba97-1f90ce2c396c None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:37.490550 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b49dc4-1b6f-4edd-ba97-1f90ce2c396c None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:37.490550 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b49dc4-1b6f-4edd-ba97-1f90ce2c396c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:37.498073 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b49dc4-1b6f-4edd-ba97-1f90ce2c396c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:37.499612 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b49dc4-1b6f-4edd-ba97-1f90ce2c396c None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:37.518126 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-22b49dc4-1b6f-4edd-ba97-1f90ce2c396c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:37.518126 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:37.518126 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:37.518126 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:37.518126 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:37.518126 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:37.518126 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:37.518126 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:37.518126 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:37.518126 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:37.518126 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:37.518126 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:37.518126 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:37.518126 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:37.518126 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:37.518126 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:37.519070 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:37.519070 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:37.519070 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:37.519070 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:37.519070 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:37.519070 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:37.519070 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:37.519070 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:37.519070 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:37.519070 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:37.519070 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:37.519070 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:37.519070 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:37.519070 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:37.519070 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:37.519070 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:37.519070 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:37.520610 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:37.520610 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:37.520610 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:37.520610 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 318/618] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:37.526845 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef5082-53ae-4a1b-942e-5f0670daca3e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:37.542741 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b49dc4-1b6f-4edd-ba97-1f90ce2c396c None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:37.702424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef5082-53ae-4a1b-942e-5f0670daca3e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:37.747343 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0b6a9-b478-4f53-9476-29572f7cc1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:37.748027 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0b6a9-b478-4f53-9476-29572f7cc1fa None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:37.748307 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0b6a9-b478-4f53-9476-29572f7cc1fa None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:37.748577 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0b6a9-b478-4f53-9476-29572f7cc1fa None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:37.749252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0b6a9-b478-4f53-9476-29572f7cc1fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:37.749558 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0b6a9-b478-4f53-9476-29572f7cc1fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:37.750929 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0b6a9-b478-4f53-9476-29572f7cc1fa None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:37.758248 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b49dc4-1b6f-4edd-ba97-1f90ce2c396c None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:37.782353 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 301/619] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:37.785164 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0b6a9-b478-4f53-9476-29572f7cc1fa None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:37.796809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:37.859667 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1722a09-9a72-4e10-9924-5941f56a408a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:37.860741 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1722a09-9a72-4e10-9924-5941f56a408a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:37.861223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1722a09-9a72-4e10-9924-5941f56a408a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:37.861719 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1722a09-9a72-4e10-9924-5941f56a408a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:37.887899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1722a09-9a72-4e10-9924-5941f56a408a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:37.893419 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-b1722a09-9a72-4e10-9924-5941f56a408a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:26:37.893419 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:37.893419 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:37.893419 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:37.893419 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:37.893419 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:37.893419 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:37.893419 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:37.893419 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:37.893419 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:37.893419 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:37.893419 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:37.893419 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:37.893419 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:37.893419 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:37.893419 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:37.894344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:37.894344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:37.894344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:37.894344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:37.894344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:37.894344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:37.894344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:37.894344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:37.894344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:37.894344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:37.894344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:37.894344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:37.894344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:37.894344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:37.894344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:37.894344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:37.895155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:37.895155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:37.895155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:37.895155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:37.895155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:37.895155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:37.895155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:37.895155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:37.895155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:37.895155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:37.895155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:26:37.895155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:37.902669 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 319/620] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 22 20:26:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:37.909491 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1722a09-9a72-4e10-9924-5941f56a408a None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:37.927684 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0b6a9-b478-4f53-9476-29572f7cc1fa None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:37.990465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a9eca-f2a7-47dc-8956-239eb9fee33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:37.991531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a9eca-f2a7-47dc-8956-239eb9fee33b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:37.992006 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a9eca-f2a7-47dc-8956-239eb9fee33b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:37.992494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a9eca-f2a7-47dc-8956-239eb9fee33b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:37.997058 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:38.002461 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a9eca-f2a7-47dc-8956-239eb9fee33b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:38.004644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a9eca-f2a7-47dc-8956-239eb9fee33b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:38.019504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-446a9eca-f2a7-47dc-8956-239eb9fee33b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:38.019504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:38.019504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:38.019504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:38.019504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:38.019504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:38.019504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:38.019504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:38.019504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:38.019504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:38.019504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:38.019504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:38.019504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:26:38.019504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:26:38.019504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:26:38.020679 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:26:38.020679 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:38.020679 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:38.020679 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:38.020679 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:38.020679 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:38.020679 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:38.020679 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:38.020679 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:38.020679 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:38.020679 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:38.020679 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:38.020679 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:38.020679 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:38.020679 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:38.020679 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:38.020679 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:38.021576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:26:38.021576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:26:38.021576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:26:38.021576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:26:38.021576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:26:38.021576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:26:38.021576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:38.021576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:38.021576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 302/621] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:26:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:38.022522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b446f-1851-4471-bc5e-03cbe809d2d7 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:38.022629 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b446f-1851-4471-bc5e-03cbe809d2d7 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:38.022817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b446f-1851-4471-bc5e-03cbe809d2d7 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:38.024394 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 303/622] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:38.033929 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ee888-dd0f-424a-826c-bc986fb157fb None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:38.034208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ee888-dd0f-424a-826c-bc986fb157fb None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:38.034479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ee888-dd0f-424a-826c-bc986fb157fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:38.058597 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-fa5ee888-dd0f-424a-826c-bc986fb157fb None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:38.059989 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-fa5ee888-dd0f-424a-826c-bc986fb157fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:38.063423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1722a09-9a72-4e10-9924-5941f56a408a None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:38.100337 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c511a4-bae8-4e5a-b79e-7b70f0c1fab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:38.101306 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c511a4-bae8-4e5a-b79e-7b70f0c1fab4 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:38.101825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c511a4-bae8-4e5a-b79e-7b70f0c1fab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:38.102246 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c511a4-bae8-4e5a-b79e-7b70f0c1fab4 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:38.103047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c511a4-bae8-4e5a-b79e-7b70f0c1fab4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:38.103494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c511a4-bae8-4e5a-b79e-7b70f0c1fab4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:38.105074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c511a4-bae8-4e5a-b79e-7b70f0c1fab4 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:38.114675 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 320/623] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 22 20:26:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:38.115697 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c511a4-bae8-4e5a-b79e-7b70f0c1fab4 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:38.135237 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:38.146268 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 304/624] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:38.147305 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ee888-dd0f-424a-826c-bc986fb157fb None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:38.289789 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c511a4-bae8-4e5a-b79e-7b70f0c1fab4 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:38.304042 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:38.327984 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ee888-dd0f-424a-826c-bc986fb157fb None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:38.367259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0fb21-e32c-468b-b624-2002e8f9ab33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:38.367865 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0fb21-e32c-468b-b624-2002e8f9ab33 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:38.368143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0fb21-e32c-468b-b624-2002e8f9ab33 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:38.368420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0fb21-e32c-468b-b624-2002e8f9ab33 None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:38.369145 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0fb21-e32c-468b-b624-2002e8f9ab33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:38.369447 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0fb21-e32c-468b-b624-2002e8f9ab33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:38.370880 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0fb21-e32c-468b-b624-2002e8f9ab33 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:38.384573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 321/625] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 22 20:26:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:38.390393 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0fb21-e32c-468b-b624-2002e8f9ab33 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:38.406566 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12b923-cf55-41b0-97b5-93b73616dd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:38.407344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12b923-cf55-41b0-97b5-93b73616dd1d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:38.407699 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12b923-cf55-41b0-97b5-93b73616dd1d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:38.408046 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12b923-cf55-41b0-97b5-93b73616dd1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:38.429530 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd12b923-cf55-41b0-97b5-93b73616dd1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:38.436551 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd12b923-cf55-41b0-97b5-93b73616dd1d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:38.468501 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-fd12b923-cf55-41b0-97b5-93b73616dd1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:38.468501 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:38.468501 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:38.468501 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:38.468501 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:38.468501 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:38.468501 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:38.468501 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:38.468501 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:38.468501 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:38.468501 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:38.468501 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:38.468501 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:38.468501 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:38.468501 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:38.468501 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:38.469715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:38.469715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:38.469715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:38.469715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:38.469715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:38.469715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:38.469715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:38.469715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:38.469715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:38.469715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:38.469715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:38.469715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:38.469715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:38.469715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:38.469715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:38.469715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:38.469715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:38.470807 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:38.470807 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:38.470807 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:38.475395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 305/626] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:38.477979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12b923-cf55-41b0-97b5-93b73616dd1d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:38.548162 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:38.559815 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0fb21-e32c-468b-b624-2002e8f9ab33 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:38.597596 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528d75b-c345-4c92-b603-3150c728ba90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:38.598148 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528d75b-c345-4c92-b603-3150c728ba90 None admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:38.598427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528d75b-c345-4c92-b603-3150c728ba90 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:38.598699 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528d75b-c345-4c92-b603-3150c728ba90 None admin] PATH_INFO: `/v3/projects/783c362712d34405ab827e3f00a67995/users/907607fd209b416ba9b68512772c1d17/roles/38bb7e6ed5854439aeaf5996eb6892f6` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:38.615817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528d75b-c345-4c92-b603-3150c728ba90 None admin] RBAC: Authorizing `identity:create_grant(project_id=783c362712d34405ab827e3f00a67995, user_id=907607fd209b416ba9b68512772c1d17, role_id=38bb7e6ed5854439aeaf5996eb6892f6)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:38.619789 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528d75b-c345-4c92-b603-3150c728ba90 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:38.619945 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12b923-cf55-41b0-97b5-93b73616dd1d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:38.653794 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c932eb-a32d-4d45-bc40-d19dcfc0577a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:38.654399 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c932eb-a32d-4d45-bc40-d19dcfc0577a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:38.654755 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c932eb-a32d-4d45-bc40-d19dcfc0577a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:38.654977 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c932eb-a32d-4d45-bc40-d19dcfc0577a None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:38.655659 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c932eb-a32d-4d45-bc40-d19dcfc0577a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:38.655916 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c932eb-a32d-4d45-bc40-d19dcfc0577a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:38.657309 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c932eb-a32d-4d45-bc40-d19dcfc0577a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:38.669196 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 306/627] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:38.669987 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c932eb-a32d-4d45-bc40-d19dcfc0577a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:38.747267 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 322/628] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 22 20:26:38 2022] PUT /identity/v3/projects/783c362712d34405ab827e3f00a67995/users/907607fd209b416ba9b68512772c1d17/roles/38bb7e6ed5854439aeaf5996eb6892f6 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:26:38.748863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef960d-5807-4420-bf66-84495e2ce04e None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:38.749447 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef960d-5807-4420-bf66-84495e2ce04e None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:38.749903 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef960d-5807-4420-bf66-84495e2ce04e None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:38.751432 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 323/629] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:38.752373 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef960d-5807-4420-bf66-84495e2ce04e None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:38.783601 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:38.800087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c932eb-a32d-4d45-bc40-d19dcfc0577a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:38.805113 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:38.852588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abf033-84cf-4d94-b0f5-2375a8ee4d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:38.854379 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abf033-84cf-4d94-b0f5-2375a8ee4d30 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:38.854811 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abf033-84cf-4d94-b0f5-2375a8ee4d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:38.855220 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abf033-84cf-4d94-b0f5-2375a8ee4d30 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:38.871384 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abf033-84cf-4d94-b0f5-2375a8ee4d30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:38.878402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-11abf033-84cf-4d94-b0f5-2375a8ee4d30 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:26:38.878402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:38.878402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:38.878402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:38.878402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:38.878402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:38.878402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:38.878402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:38.878402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:38.878402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:38.878402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:38.878402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:38.878402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:38.878402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:38.878402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:38.878402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:38.880098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:38.880098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:38.880098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:38.880098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:38.880098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:38.880098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:38.880098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:38.880098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:38.880098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:38.880098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:38.880098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:38.880098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:38.880098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:38.880098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:38.880098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:38.880098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:38.881252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:38.881252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:38.881252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:38.881252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:38.881252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:38.881252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:38.881252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:38.881252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:38.881252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:38.881252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:38.881252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:26:38.881252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:38.884454 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 307/630] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 22 20:26:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:38.885998 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd9922-0de5-44ae-bfb8-ed6fae2b1358 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:38.886413 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd9922-0de5-44ae-bfb8-ed6fae2b1358 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:38.886835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd9922-0de5-44ae-bfb8-ed6fae2b1358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:38.906317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef960d-5807-4420-bf66-84495e2ce04e None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:38.909707 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-b2cd9922-0de5-44ae-bfb8-ed6fae2b1358 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:38.911099 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b2cd9922-0de5-44ae-bfb8-ed6fae2b1358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:38.946357 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca1ef8-7a96-483f-a6c6-f1a68c544a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:38.946992 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca1ef8-7a96-483f-a6c6-f1a68c544a7b None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:38.947270 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca1ef8-7a96-483f-a6c6-f1a68c544a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:38.947542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca1ef8-7a96-483f-a6c6-f1a68c544a7b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:38.961572 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca1ef8-7a96-483f-a6c6-f1a68c544a7b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:38.963029 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca1ef8-7a96-483f-a6c6-f1a68c544a7b None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:38.978521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-42ca1ef8-7a96-483f-a6c6-f1a68c544a7b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:26:38.978521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:38.978521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:38.978521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:38.978521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:38.978521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:38.978521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:38.978521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:38.978521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:38.978521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:38.978521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:38.978521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:38.978521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:26:38.978521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:26:38.978521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:26:38.978521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:26:38.979727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:38.979727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:38.979727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:26:38.979727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:38.979727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:26:38.979727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:38.979727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:38.979727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:38.979727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:38.979727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:38.979727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:38.979727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:38.979727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:38.979727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:38.979727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:38.979727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:38.979727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:38.979727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:38.980697 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:38.980697 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:38.980697 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:26:38.980697 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:26:38.980697 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:26:38.980697 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:26:38.980697 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:26:38.980697 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:26:38.980697 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:26:38.980697 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:38.980697 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 324/631] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Aug 22 20:26:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:38.981302 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca1ef8-7a96-483f-a6c6-f1a68c544a7b None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:38.995790 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 308/632] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:38.997140 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd9922-0de5-44ae-bfb8-ed6fae2b1358 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:39.080538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:39.107189 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca1ef8-7a96-483f-a6c6-f1a68c544a7b None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:39.145417 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759020cf-94a1-44ea-a362-1fb7cff55506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:39.146080 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759020cf-94a1-44ea-a362-1fb7cff55506 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:39.146363 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759020cf-94a1-44ea-a362-1fb7cff55506 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:39.146637 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759020cf-94a1-44ea-a362-1fb7cff55506 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:39.147472 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759020cf-94a1-44ea-a362-1fb7cff55506 None admin] RBAC: Adding query filter params (name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:39.147768 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759020cf-94a1-44ea-a362-1fb7cff55506 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:39.149500 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759020cf-94a1-44ea-a362-1fb7cff55506 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:39.158816 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 325/633] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 22 20:26:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:39.166884 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759020cf-94a1-44ea-a362-1fb7cff55506 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:39.217167 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:39.224614 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd9922-0de5-44ae-bfb8-ed6fae2b1358 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:39.294017 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0b345-315b-434b-9e7b-8691c77b2854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:39.294882 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0b345-315b-434b-9e7b-8691c77b2854 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:39.295346 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0b345-315b-434b-9e7b-8691c77b2854 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:39.295765 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0b345-315b-434b-9e7b-8691c77b2854 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:39.296647 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0b345-315b-434b-9e7b-8691c77b2854 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:39.297122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0b345-315b-434b-9e7b-8691c77b2854 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:39.298700 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0b345-315b-434b-9e7b-8691c77b2854 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:39.318986 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 309/634] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Aug 22 20:26:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:39.320134 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0b345-315b-434b-9e7b-8691c77b2854 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:39.352860 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759020cf-94a1-44ea-a362-1fb7cff55506 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:39.388025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0dcad-9181-4997-8403-39577bd2ed40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:39.388482 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0dcad-9181-4997-8403-39577bd2ed40 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:39.388787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0dcad-9181-4997-8403-39577bd2ed40 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:39.389054 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0dcad-9181-4997-8403-39577bd2ed40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:39.397219 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:39.400887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0dcad-9181-4997-8403-39577bd2ed40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:39.402342 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0dcad-9181-4997-8403-39577bd2ed40 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:39.417188 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-34c0dcad-9181-4997-8403-39577bd2ed40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:39.417188 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:39.417188 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:39.417188 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:39.417188 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:39.417188 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:39.417188 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:39.417188 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:39.417188 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:39.417188 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:39.417188 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:39.417188 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:39.417188 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:39.417188 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:39.417188 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:39.417188 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:39.418184 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:39.418184 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:39.418184 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:39.418184 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:39.418184 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:39.418184 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:39.418184 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:39.418184 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:39.418184 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:39.418184 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:39.418184 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:39.418184 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:39.418184 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:39.418184 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:39.418184 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:39.418184 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:39.418184 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:39.419071 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:39.419071 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:39.419071 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:39.419071 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 326/635] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:39.419071 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0dcad-9181-4997-8403-39577bd2ed40 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:39.435917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0b345-315b-434b-9e7b-8691c77b2854 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:39.478406 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3c8da-1ecd-4a78-b06d-4ac788f3768a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:39.479352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3c8da-1ecd-4a78-b06d-4ac788f3768a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:39.479852 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3c8da-1ecd-4a78-b06d-4ac788f3768a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:39.480315 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3c8da-1ecd-4a78-b06d-4ac788f3768a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:39.491712 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a3c8da-1ecd-4a78-b06d-4ac788f3768a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:39.496426 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-f0a3c8da-1ecd-4a78-b06d-4ac788f3768a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:26:39.496426 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:39.496426 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:39.496426 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:39.496426 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:39.496426 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:39.496426 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:39.496426 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:39.496426 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:39.496426 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:39.496426 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:39.496426 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:39.496426 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:39.496426 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:39.496426 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:39.496426 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:39.497620 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:39.497620 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:39.497620 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:39.497620 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:39.497620 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:39.497620 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:39.497620 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:39.497620 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:39.497620 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:39.497620 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:39.497620 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:39.497620 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:39.497620 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:39.497620 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:39.497620 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:39.497620 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:39.498662 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:39.498662 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:39.498662 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:39.498662 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:39.498662 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:39.498662 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:39.498662 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:39.498662 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:39.498662 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:39.498662 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:39.498662 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:26:39.498662 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:39.500726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 310/636] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 22 20:26:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:39.501635 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed2b92-027c-41ba-bc31-4326e867b9c7 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:39.502011 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed2b92-027c-41ba-bc31-4326e867b9c7 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:39.502377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed2b92-027c-41ba-bc31-4326e867b9c7 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:39.508860 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 311/637] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:39.508860 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed2b92-027c-41ba-bc31-4326e867b9c7 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:39.524523 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:39.532219 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0dcad-9181-4997-8403-39577bd2ed40 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:39.564782 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555968b9-7ca7-4f04-baa5-981bc80d85c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:39.565379 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555968b9-7ca7-4f04-baa5-981bc80d85c4 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:39.565655 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555968b9-7ca7-4f04-baa5-981bc80d85c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:39.566426 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555968b9-7ca7-4f04-baa5-981bc80d85c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:39.620349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed2b92-027c-41ba-bc31-4326e867b9c7 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:39.623599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:39.635952 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555968b9-7ca7-4f04-baa5-981bc80d85c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:39.637516 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555968b9-7ca7-4f04-baa5-981bc80d85c4 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:39.659829 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cbc4c-e58a-4103-bfd3-2be8a724fe03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:39.660502 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cbc4c-e58a-4103-bfd3-2be8a724fe03 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:39.660893 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cbc4c-e58a-4103-bfd3-2be8a724fe03 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:39.661235 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cbc4c-e58a-4103-bfd3-2be8a724fe03 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:39.661802 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247cbc4c-e58a-4103-bfd3-2be8a724fe03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:39.662098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247cbc4c-e58a-4103-bfd3-2be8a724fe03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:39.663464 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247cbc4c-e58a-4103-bfd3-2be8a724fe03 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:39.675256 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 312/638] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:39.676015 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cbc4c-e58a-4103-bfd3-2be8a724fe03 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:39.747594 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 327/639] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:26:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:26:39.747594 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16fc60-d0a9-43ca-9f1f-e0b1f9c974ef None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:39.747594 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16fc60-d0a9-43ca-9f1f-e0b1f9c974ef None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:39.747594 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16fc60-d0a9-43ca-9f1f-e0b1f9c974ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:39.749455 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:39.766533 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-5f16fc60-d0a9-43ca-9f1f-e0b1f9c974ef None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:39.767870 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-5f16fc60-d0a9-43ca-9f1f-e0b1f9c974ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:39.785276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cbc4c-e58a-4103-bfd3-2be8a724fe03 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:39.824758 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad2dc3-72b7-4028-9103-a83858f1a9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:39.825617 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad2dc3-72b7-4028-9103-a83858f1a9cb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:39.826003 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad2dc3-72b7-4028-9103-a83858f1a9cb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:39.826179 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad2dc3-72b7-4028-9103-a83858f1a9cb None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:39.826851 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad2dc3-72b7-4028-9103-a83858f1a9cb None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:39.827407 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad2dc3-72b7-4028-9103-a83858f1a9cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:39.828807 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad2dc3-72b7-4028-9103-a83858f1a9cb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:39.837163 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 313/640] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 22 20:26:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:39.838019 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad2dc3-72b7-4028-9103-a83858f1a9cb None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:39.854196 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 328/641] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:39.855253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16fc60-d0a9-43ca-9f1f-e0b1f9c974ef None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:39.885809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:39.977522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad2dc3-72b7-4028-9103-a83858f1a9cb None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:39.977978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16fc60-d0a9-43ca-9f1f-e0b1f9c974ef None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:40.017077 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414dffd5-0fce-49fb-99b3-ee124e661bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:40.017947 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414dffd5-0fce-49fb-99b3-ee124e661bd0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:40.018344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414dffd5-0fce-49fb-99b3-ee124e661bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:40.018730 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414dffd5-0fce-49fb-99b3-ee124e661bd0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:40.020527 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40257494-7604-46ab-b043-2fceb7596908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:40.021636 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:40.022356 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40257494-7604-46ab-b043-2fceb7596908 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:40.022784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40257494-7604-46ab-b043-2fceb7596908 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:40.023715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40257494-7604-46ab-b043-2fceb7596908 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:40.028511 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414dffd5-0fce-49fb-99b3-ee124e661bd0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:40.030101 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414dffd5-0fce-49fb-99b3-ee124e661bd0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:40.036420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40257494-7604-46ab-b043-2fceb7596908 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:40.038337 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40257494-7604-46ab-b043-2fceb7596908 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:40.042600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-414dffd5-0fce-49fb-99b3-ee124e661bd0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 20:26:40.042600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:40.042600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:40.042600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:40.042600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:40.042600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:40.042600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:40.042600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:40.042600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:40.042600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:40.042600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:40.042600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:40.042600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:26:40.042600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:26:40.042600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:26:40.042600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:26:40.043750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:40.043750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:40.043750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:26:40.043750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:40.043750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:26:40.043750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:40.043750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:40.043750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:40.043750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:40.043750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:40.043750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:40.043750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:40.043750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:40.043750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:40.043750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:40.043750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:40.043750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:40.043750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:40.044874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:40.044874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:40.044874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:26:40.044874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:26:40.044874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:26:40.044874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:26:40.044874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:26:40.044874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:26:40.044874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 20:26:40.044874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:40.050239 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 314/642] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:26:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:40.051471 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414dffd5-0fce-49fb-99b3-ee124e661bd0 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:40.061644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-40257494-7604-46ab-b043-2fceb7596908 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:40.061644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:40.061644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:40.061644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:40.061644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:40.061644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:40.061644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:40.061644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:40.061644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:40.061644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:40.061644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:40.061644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:40.061644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:40.061644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:40.061644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:40.061644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:40.062672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:40.062672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:40.062672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:40.062672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:40.062672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:40.062672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:40.062672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:40.062672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:40.062672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:40.062672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:40.062672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:40.062672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:40.062672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:40.062672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:40.062672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:40.062672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:40.062672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:40.063592 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:40.063592 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:40.063592 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:40.066787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 329/643] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:40.068078 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40257494-7604-46ab-b043-2fceb7596908 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:40.143159 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:40.171252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414dffd5-0fce-49fb-99b3-ee124e661bd0 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:40.174421 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40257494-7604-46ab-b043-2fceb7596908 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:40.210741 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ba2ad-4bb8-474e-9191-76ef124b7285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:40.211424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ba2ad-4bb8-474e-9191-76ef124b7285 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:40.211702 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ba2ad-4bb8-474e-9191-76ef124b7285 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:40.211806 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057dd7b-918d-4dbe-a97a-a3e55b72f454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:40.211998 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ba2ad-4bb8-474e-9191-76ef124b7285 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:40.212417 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057dd7b-918d-4dbe-a97a-a3e55b72f454 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:40.212719 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057dd7b-918d-4dbe-a97a-a3e55b72f454 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:40.212994 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057dd7b-918d-4dbe-a97a-a3e55b72f454 None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:40.213726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057dd7b-918d-4dbe-a97a-a3e55b72f454 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:40.214026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057dd7b-918d-4dbe-a97a-a3e55b72f454 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:40.215453 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4057dd7b-918d-4dbe-a97a-a3e55b72f454 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:40.225739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ba2ad-4bb8-474e-9191-76ef124b7285 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:40.228299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ba2ad-4bb8-474e-9191-76ef124b7285 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:40.234248 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 330/644] 10.222.0.62 () {56 vars in 1137 bytes} [Mon Aug 22 20:26:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:40.235063 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057dd7b-918d-4dbe-a97a-a3e55b72f454 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:40.249497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-5a4ba2ad-4bb8-474e-9191-76ef124b7285 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:40.249497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:40.249497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:40.249497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:40.249497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:40.249497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:40.249497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:40.249497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:40.249497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:40.249497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:40.249497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:40.249497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:40.249497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:40.249497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:40.249497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:40.249497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:40.250562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:40.250562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:40.250562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:40.250562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:40.250562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:40.250562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:40.250562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:40.250562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:40.250562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:40.250562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:40.250562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:40.250562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:40.250562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:40.250562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:40.250562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:40.250562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:40.250562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:40.251778 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:40.251778 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:40.251778 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:40.253928 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 315/645] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:40.254929 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ba2ad-4bb8-474e-9191-76ef124b7285 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:40.307880 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:40.345256 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4057dd7b-918d-4dbe-a97a-a3e55b72f454 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:40.363815 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ba2ad-4bb8-474e-9191-76ef124b7285 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:40.376268 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:40.382635 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded65c5-f58f-48fb-9392-63235a8c8d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:40.386942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded65c5-f58f-48fb-9392-63235a8c8d15 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:40.386942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded65c5-f58f-48fb-9392-63235a8c8d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:40.386942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded65c5-f58f-48fb-9392-63235a8c8d15 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:40.386942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded65c5-f58f-48fb-9392-63235a8c8d15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:40.386942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded65c5-f58f-48fb-9392-63235a8c8d15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:40.386942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded65c5-f58f-48fb-9392-63235a8c8d15 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:40.397941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 331/646] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:40.398591 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded65c5-f58f-48fb-9392-63235a8c8d15 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:40.405226 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f9106-cf83-44b7-88f7-bb47d13a8ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:40.405873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f9106-cf83-44b7-88f7-bb47d13a8ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:40.406162 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f9106-cf83-44b7-88f7-bb47d13a8ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:40.406426 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f9106-cf83-44b7-88f7-bb47d13a8ad8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:40.417769 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f9106-cf83-44b7-88f7-bb47d13a8ad8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:40.423113 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-919f9106-cf83-44b7-88f7-bb47d13a8ad8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:26:40.423113 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:40.423113 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:40.423113 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:40.423113 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:40.423113 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:40.423113 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:40.423113 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:40.423113 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:40.423113 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:40.423113 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:40.423113 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:40.423113 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:40.423113 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:40.423113 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:40.423113 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:40.424074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:40.424074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:40.424074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:40.424074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:40.424074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:40.424074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:40.424074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:40.424074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:40.424074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:40.424074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:40.424074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:40.424074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:40.424074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:40.424074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:40.424074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:40.424074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:40.424955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:40.424955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:40.424955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:40.424955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:40.424955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:40.424955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:40.424955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:40.424955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:40.424955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:40.424955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:40.424955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:26:40.424955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:40.424955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 316/647] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 22 20:26:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:40.426202 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f9106-cf83-44b7-88f7-bb47d13a8ad8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:40.514746 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded65c5-f58f-48fb-9392-63235a8c8d15 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:40.539364 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f9106-cf83-44b7-88f7-bb47d13a8ad8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:40.547524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:40.552298 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ad5a7-9bb6-4035-9d95-39ed96927b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:40.553110 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ad5a7-9bb6-4035-9d95-39ed96927b43 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:40.553529 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ad5a7-9bb6-4035-9d95-39ed96927b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:40.553938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ad5a7-9bb6-4035-9d95-39ed96927b43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:40.577120 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d041bcf0-bd4b-4087-b9dc-11120200bb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:40.577736 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041bcf0-bd4b-4087-b9dc-11120200bb4b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:40.578021 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041bcf0-bd4b-4087-b9dc-11120200bb4b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:40.578306 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041bcf0-bd4b-4087-b9dc-11120200bb4b None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:40.578950 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d041bcf0-bd4b-4087-b9dc-11120200bb4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:40.579245 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d041bcf0-bd4b-4087-b9dc-11120200bb4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:40.580625 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d041bcf0-bd4b-4087-b9dc-11120200bb4b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:40.592538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 317/648] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:40.593399 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d041bcf0-bd4b-4087-b9dc-11120200bb4b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:40.618806 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:40.631449 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ad5a7-9bb6-4035-9d95-39ed96927b43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:40.633078 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ad5a7-9bb6-4035-9d95-39ed96927b43 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:40.708436 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d041bcf0-bd4b-4087-b9dc-11120200bb4b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:40.737432 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 332/649] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:26:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:26:40.738790 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ad5a7-9bb6-4035-9d95-39ed96927b43 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:40.747930 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec89e5a-d152-461d-b8a1-df1586822662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:40.748569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec89e5a-d152-461d-b8a1-df1586822662 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:40.748881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec89e5a-d152-461d-b8a1-df1586822662 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:40.749157 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec89e5a-d152-461d-b8a1-df1586822662 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:40.756505 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec89e5a-d152-461d-b8a1-df1586822662 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:40.758055 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec89e5a-d152-461d-b8a1-df1586822662 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:40.773429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-6ec89e5a-d152-461d-b8a1-df1586822662 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:40.773429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:40.773429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:40.773429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:40.773429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:40.773429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:40.773429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:40.773429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:40.773429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:40.773429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:40.773429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:40.773429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:40.773429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:26:40.773429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:26:40.773429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:26:40.774489 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:26:40.774489 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:40.774489 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:40.774489 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:40.774489 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:40.774489 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:40.774489 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:40.774489 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:40.774489 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:40.774489 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:40.774489 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:40.774489 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:40.774489 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:40.774489 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:40.774489 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:40.774489 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:40.774489 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:40.775394 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:26:40.775394 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:26:40.775394 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:26:40.775394 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:26:40.775394 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:26:40.775394 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:26:40.775394 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:40.775394 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:40.775394 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 318/650] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:26:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:40.775394 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec89e5a-d152-461d-b8a1-df1586822662 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:40.807937 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:40.827864 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:40.837310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ad5a7-9bb6-4035-9d95-39ed96927b43 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:40.871295 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d981f2-dc74-4998-b04e-01d8b6fe91e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:40.871890 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d981f2-dc74-4998-b04e-01d8b6fe91e0 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:40.872163 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d981f2-dc74-4998-b04e-01d8b6fe91e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:40.872435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d981f2-dc74-4998-b04e-01d8b6fe91e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:40.873119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d981f2-dc74-4998-b04e-01d8b6fe91e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:40.873418 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d981f2-dc74-4998-b04e-01d8b6fe91e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:40.874767 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d981f2-dc74-4998-b04e-01d8b6fe91e0 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:40.881564 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec89e5a-d152-461d-b8a1-df1586822662 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:40.883026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 333/651] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 22 20:26:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:40.884176 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fa4b6-6a11-4980-a0cc-2c3a36f19847 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:40.884459 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fa4b6-6a11-4980-a0cc-2c3a36f19847 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:40.884769 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fa4b6-6a11-4980-a0cc-2c3a36f19847 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:40.886092 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 334/652] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:40.886609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18fa4b6-6a11-4980-a0cc-2c3a36f19847 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:40.918388 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d54a9-4fc6-477d-8d7e-f39f20a2b774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:40.919009 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d54a9-4fc6-477d-8d7e-f39f20a2b774 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:40.919285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d54a9-4fc6-477d-8d7e-f39f20a2b774 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:40.919551 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d54a9-4fc6-477d-8d7e-f39f20a2b774 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:40.928349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d54a9-4fc6-477d-8d7e-f39f20a2b774 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:40.929816 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2d54a9-4fc6-477d-8d7e-f39f20a2b774 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:40.941466 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-4a2d54a9-4fc6-477d-8d7e-f39f20a2b774 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 22 20:26:40.941466 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:40.941466 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:40.941466 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:40.941466 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:40.941466 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:40.941466 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:40.941466 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:40.941466 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:40.941466 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:40.941466 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:40.941466 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:40.941466 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:26:40.941466 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:26:40.941466 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:26:40.941466 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:26:40.942734 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:40.942734 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:40.942734 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:26:40.942734 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:40.942734 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:26:40.942734 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:40.942734 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:40.942734 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:40.942734 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:40.942734 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:40.942734 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:40.942734 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:40.942734 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:40.942734 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:40.942734 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:40.942734 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:40.942734 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:40.942734 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:40.943750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:40.943750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:40.943750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:26:40.943750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:26:40.943750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:26:40.943750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:26:40.943750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:26:40.943750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:26:40.943750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 22 20:26:40.943750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:40.943750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 319/653] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:26:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:40.943750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d54a9-4fc6-477d-8d7e-f39f20a2b774 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:40.992050 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18fa4b6-6a11-4980-a0cc-2c3a36f19847 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:41.025832 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca68ae-9652-4e42-841b-198c7a572c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:41.026377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca68ae-9652-4e42-841b-198c7a572c8d None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:41.026651 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca68ae-9652-4e42-841b-198c7a572c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:41.026921 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca68ae-9652-4e42-841b-198c7a572c8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:41.028909 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:41.037340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca68ae-9652-4e42-841b-198c7a572c8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:41.038821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca68ae-9652-4e42-841b-198c7a572c8d None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:41.043872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d54a9-4fc6-477d-8d7e-f39f20a2b774 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:41.053867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-10ca68ae-9652-4e42-841b-198c7a572c8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:41.053867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:41.053867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:41.053867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:41.053867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:41.053867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:41.053867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:41.053867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:41.053867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:41.053867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:41.053867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:41.053867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:41.053867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:41.053867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:41.053867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:41.053867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:41.054995 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:41.054995 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:41.054995 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:41.054995 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:41.054995 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:41.054995 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:41.054995 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:41.054995 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:41.054995 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:41.054995 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:41.054995 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:41.054995 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:41.054995 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:41.054995 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:41.054995 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:41.054995 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:41.054995 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:41.055887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:41.055887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:41.055887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:41.055887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 335/654] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:41.055887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca68ae-9652-4e42-841b-198c7a572c8d None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:41.062552 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:41.083359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059af485-e0ac-4a28-9848-da8910068215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:41.083961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059af485-e0ac-4a28-9848-da8910068215 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:41.084241 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059af485-e0ac-4a28-9848-da8910068215 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:41.084515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059af485-e0ac-4a28-9848-da8910068215 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:41.085235 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059af485-e0ac-4a28-9848-da8910068215 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:41.085666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059af485-e0ac-4a28-9848-da8910068215 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:41.087093 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059af485-e0ac-4a28-9848-da8910068215 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:41.101175 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 320/655] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 22 20:26:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:41.102574 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d13d66-005b-4b7c-9c92-96a5d0d7a6a9 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:41.102856 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d13d66-005b-4b7c-9c92-96a5d0d7a6a9 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:41.103131 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d13d66-005b-4b7c-9c92-96a5d0d7a6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:41.120900 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-e6d13d66-005b-4b7c-9c92-96a5d0d7a6a9 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:41.122343 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e6d13d66-005b-4b7c-9c92-96a5d0d7a6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:41.162940 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca68ae-9652-4e42-841b-198c7a572c8d None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:41.190052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 321/656] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:41.190989 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d13d66-005b-4b7c-9c92-96a5d0d7a6a9 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:41.210903 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d2427-bef4-483e-bc0f-a39a1cca8d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:41.211590 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d2427-bef4-483e-bc0f-a39a1cca8d10 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:41.211827 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d2427-bef4-483e-bc0f-a39a1cca8d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:41.212099 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d2427-bef4-483e-bc0f-a39a1cca8d10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:41.223668 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d2427-bef4-483e-bc0f-a39a1cca8d10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:41.225136 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d2427-bef4-483e-bc0f-a39a1cca8d10 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:41.239570 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-a39d2427-bef4-483e-bc0f-a39a1cca8d10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:41.239570 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:41.239570 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:41.239570 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:41.239570 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:41.239570 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:41.239570 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:41.239570 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:41.239570 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:41.239570 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:41.239570 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:41.239570 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:41.239570 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:41.239570 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:41.239570 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:41.239570 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:41.240520 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:41.240520 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:41.240520 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:41.240520 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:41.240520 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:41.240520 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:41.240520 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:41.240520 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:41.240520 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:41.240520 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:41.240520 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:41.240520 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:41.240520 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:41.240520 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:41.240520 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:41.240520 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:41.240520 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:41.241475 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:41.241475 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:41.241475 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:41.241475 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 336/657] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:41.241475 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d2427-bef4-483e-bc0f-a39a1cca8d10 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:41.274444 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:41.298124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d13d66-005b-4b7c-9c92-96a5d0d7a6a9 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:41.307846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:41.334625 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1542270-483e-4e73-a51e-26d7dd073498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:41.335233 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1542270-483e-4e73-a51e-26d7dd073498 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:41.335511 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1542270-483e-4e73-a51e-26d7dd073498 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:41.335881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1542270-483e-4e73-a51e-26d7dd073498 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:41.336610 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1542270-483e-4e73-a51e-26d7dd073498 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:41.336939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1542270-483e-4e73-a51e-26d7dd073498 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:41.338365 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1542270-483e-4e73-a51e-26d7dd073498 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:41.357636 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d2427-bef4-483e-bc0f-a39a1cca8d10 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:41.357879 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 322/658] 10.222.0.62 () {56 vars in 1137 bytes} [Mon Aug 22 20:26:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:41.358854 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1542270-483e-4e73-a51e-26d7dd073498 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:41.396210 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc13a5b-7386-439f-85ca-4ffead67103e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:41.396844 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc13a5b-7386-439f-85ca-4ffead67103e None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:41.397125 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc13a5b-7386-439f-85ca-4ffead67103e None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:41.397394 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc13a5b-7386-439f-85ca-4ffead67103e None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:41.398025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc13a5b-7386-439f-85ca-4ffead67103e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:41.398323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc13a5b-7386-439f-85ca-4ffead67103e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:41.399678 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc13a5b-7386-439f-85ca-4ffead67103e None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:41.416376 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 337/659] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:41.416376 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc13a5b-7386-439f-85ca-4ffead67103e None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:41.479638 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1542270-483e-4e73-a51e-26d7dd073498 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:41.512869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0a10f-0649-4f47-bd21-31d2ed868112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:41.513052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc13a5b-7386-439f-85ca-4ffead67103e None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:41.513470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0a10f-0649-4f47-bd21-31d2ed868112 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:41.513750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0a10f-0649-4f47-bd21-31d2ed868112 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:41.514025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0a10f-0649-4f47-bd21-31d2ed868112 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:41.514743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0a10f-0649-4f47-bd21-31d2ed868112 None admin] RBAC: Adding query filter params (role.id=38bb7e6ed5854439aeaf5996eb6892f6, scope.project.id=783c362712d34405ab827e3f00a67995, user.id=9f1738f72b4848499cdf0ec6866c3c8f) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:41.515041 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0a10f-0649-4f47-bd21-31d2ed868112 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:41.516486 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0a10f-0649-4f47-bd21-31d2ed868112 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:41.518251 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:41.523864 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 323/660] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:26:41 2022] GET /identity/v3/role_assignments?user.id=9f1738f72b4848499cdf0ec6866c3c8f&scope.project.id=783c362712d34405ab827e3f00a67995&role.id=38bb7e6ed5854439aeaf5996eb6892f6 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:41.524674 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0a10f-0649-4f47-bd21-31d2ed868112 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:41.531465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:41.552727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747ed78-52d5-4d87-9cf3-37b90f8bdfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:41.553275 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747ed78-52d5-4d87-9cf3-37b90f8bdfb9 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:41.553555 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747ed78-52d5-4d87-9cf3-37b90f8bdfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:41.553827 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747ed78-52d5-4d87-9cf3-37b90f8bdfb9 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:41.554484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747ed78-52d5-4d87-9cf3-37b90f8bdfb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:41.554782 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747ed78-52d5-4d87-9cf3-37b90f8bdfb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:41.556200 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747ed78-52d5-4d87-9cf3-37b90f8bdfb9 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:41.574004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 338/661] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:41.574004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747ed78-52d5-4d87-9cf3-37b90f8bdfb9 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:41.651267 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0a10f-0649-4f47-bd21-31d2ed868112 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:41.693372 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747ed78-52d5-4d87-9cf3-37b90f8bdfb9 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:41.694452 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec85bf4-a36b-498a-8000-e5ebb0e493ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:41.695070 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec85bf4-a36b-498a-8000-e5ebb0e493ed None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:41.695357 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec85bf4-a36b-498a-8000-e5ebb0e493ed None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:41.695634 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec85bf4-a36b-498a-8000-e5ebb0e493ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:41.735382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908aa6b7-1dd3-4a73-bb49-1d8526f97994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:41.736016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908aa6b7-1dd3-4a73-bb49-1d8526f97994 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:41.736481 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908aa6b7-1dd3-4a73-bb49-1d8526f97994 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:41.736803 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908aa6b7-1dd3-4a73-bb49-1d8526f97994 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:41.745526 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908aa6b7-1dd3-4a73-bb49-1d8526f97994 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:41.746993 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908aa6b7-1dd3-4a73-bb49-1d8526f97994 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:41.759352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-908aa6b7-1dd3-4a73-bb49-1d8526f97994 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:41.759352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:41.759352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:41.759352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:41.759352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:41.759352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:41.759352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:41.759352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:41.759352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:41.759352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:41.759352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:41.759352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:41.759352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:26:41.759352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:26:41.759352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:26:41.760431 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:26:41.760431 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:41.760431 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:41.760431 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:41.760431 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:41.760431 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:41.760431 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:41.760431 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:41.760431 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:41.760431 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:41.760431 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:41.760431 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:41.760431 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:41.760431 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:41.760431 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:41.760431 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:41.760431 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:41.761704 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:26:41.761704 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:26:41.761704 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:26:41.761704 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:26:41.761704 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:26:41.761704 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:26:41.761704 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:41.761704 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:41.761704 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 339/662] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:26:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:41.761704 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908aa6b7-1dd3-4a73-bb49-1d8526f97994 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:41.775370 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:41.779534 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec85bf4-a36b-498a-8000-e5ebb0e493ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:41.781133 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec85bf4-a36b-498a-8000-e5ebb0e493ed None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:41.804572 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:41.879764 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908aa6b7-1dd3-4a73-bb49-1d8526f97994 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:41.890441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 324/663] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:26:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:26:41.891103 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec85bf4-a36b-498a-8000-e5ebb0e493ed None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:41.920160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12333809-7963-4408-b11c-264867f6bccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:41.920806 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12333809-7963-4408-b11c-264867f6bccf None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:41.921083 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12333809-7963-4408-b11c-264867f6bccf None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:41.921350 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12333809-7963-4408-b11c-264867f6bccf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:41.933367 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12333809-7963-4408-b11c-264867f6bccf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:41.938651 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-12333809-7963-4408-b11c-264867f6bccf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:26:41.938651 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:41.938651 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:41.938651 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:41.938651 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:41.938651 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:41.938651 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:41.938651 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:41.938651 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:41.938651 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:41.938651 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:41.938651 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:41.938651 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:41.938651 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:41.938651 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:41.938651 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:41.939771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:41.939771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:41.939771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:41.939771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:41.939771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:41.939771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:41.939771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:41.939771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:41.939771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:41.939771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:41.939771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:41.939771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:41.939771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:41.939771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:41.939771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:41.939771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:41.940703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:41.940703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:41.940703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:41.940703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:41.940703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:41.940703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:41.940703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:41.940703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:41.940703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:41.940703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:41.940703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:26:41.940703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:41.940703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 340/664] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 22 20:26:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:41.940703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12333809-7963-4408-b11c-264867f6bccf None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:41.995258 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:41.999610 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec85bf4-a36b-498a-8000-e5ebb0e493ed None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:42.037876 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207a53a-77dd-4dfe-9ace-7ce4ff297a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:42.038508 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207a53a-77dd-4dfe-9ace-7ce4ff297a01 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:42.038785 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207a53a-77dd-4dfe-9ace-7ce4ff297a01 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:42.039053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207a53a-77dd-4dfe-9ace-7ce4ff297a01 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:42.040647 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:42.046572 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207a53a-77dd-4dfe-9ace-7ce4ff297a01 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:42.047368 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12333809-7963-4408-b11c-264867f6bccf None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:42.048010 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207a53a-77dd-4dfe-9ace-7ce4ff297a01 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:42.063894 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-c207a53a-77dd-4dfe-9ace-7ce4ff297a01 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 20:26:42.063894 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:42.063894 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:42.063894 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:42.063894 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:42.063894 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:42.063894 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:42.063894 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:42.063894 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:42.063894 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:42.063894 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:42.063894 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:42.063894 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:26:42.063894 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:26:42.063894 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:26:42.063894 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:26:42.064936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:42.064936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:42.064936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:26:42.064936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:42.064936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:26:42.064936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:42.064936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:42.064936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:42.064936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:42.064936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:42.064936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:42.064936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:42.064936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:42.064936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:42.064936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:42.064936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:42.064936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:42.064936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:42.066470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:42.066470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:42.066470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:26:42.066470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:26:42.066470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:26:42.066470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:26:42.066470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:26:42.066470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:26:42.066470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 20:26:42.066470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:42.066470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 325/665] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 22 20:26:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:42.066470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207a53a-77dd-4dfe-9ace-7ce4ff297a01 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:42.086896 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579bd35-48a7-40a2-9b09-d8eba955e0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:42.087498 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579bd35-48a7-40a2-9b09-d8eba955e0c8 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:42.087772 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579bd35-48a7-40a2-9b09-d8eba955e0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:42.088041 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579bd35-48a7-40a2-9b09-d8eba955e0c8 None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:42.088760 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579bd35-48a7-40a2-9b09-d8eba955e0c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:42.089337 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579bd35-48a7-40a2-9b09-d8eba955e0c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:42.091521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579bd35-48a7-40a2-9b09-d8eba955e0c8 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:42.103404 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 341/666] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 22 20:26:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:42.104211 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579bd35-48a7-40a2-9b09-d8eba955e0c8 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:42.180347 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207a53a-77dd-4dfe-9ace-7ce4ff297a01 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:42.214136 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579bd35-48a7-40a2-9b09-d8eba955e0c8 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:42.215995 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c31123-2ae8-437b-88b4-b36c344fc292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:42.217036 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c31123-2ae8-437b-88b4-b36c344fc292 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:42.217036 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c31123-2ae8-437b-88b4-b36c344fc292 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:42.217226 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c31123-2ae8-437b-88b4-b36c344fc292 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:42.228307 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c31123-2ae8-437b-88b4-b36c344fc292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:42.229860 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c31123-2ae8-437b-88b4-b36c344fc292 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:42.244926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-22c31123-2ae8-437b-88b4-b36c344fc292 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:42.244926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:42.244926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:42.244926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:42.244926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:42.244926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:42.244926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:42.244926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:42.244926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:42.244926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:42.244926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:42.244926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:42.244926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:42.244926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:42.244926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:42.244926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:42.245886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:42.245886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:42.245886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:42.245886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:42.245886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:42.245886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:42.245886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:42.245886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:42.245886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:42.245886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:42.245886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:42.245886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:42.245886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:42.245886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:42.245886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:42.245886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:42.245886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:42.246758 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:42.246758 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:42.246758 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:42.246758 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 326/667] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:42.246758 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c31123-2ae8-437b-88b4-b36c344fc292 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:42.255743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9211db-5350-4f08-bd9d-693e5cfa4912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:42.256353 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9211db-5350-4f08-bd9d-693e5cfa4912 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:42.256934 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9211db-5350-4f08-bd9d-693e5cfa4912 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:42.256934 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9211db-5350-4f08-bd9d-693e5cfa4912 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:42.257710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9211db-5350-4f08-bd9d-693e5cfa4912 None admin] RBAC: Adding query filter params (name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:42.258017 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9211db-5350-4f08-bd9d-693e5cfa4912 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:42.259388 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9211db-5350-4f08-bd9d-693e5cfa4912 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:42.260597 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:42.272249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 342/668] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 22 20:26:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:42.272249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9211db-5350-4f08-bd9d-693e5cfa4912 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:42.289420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:42.361274 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c31123-2ae8-437b-88b4-b36c344fc292 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:42.369673 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9211db-5350-4f08-bd9d-693e5cfa4912 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:42.397241 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbf6a0-f1d0-4a0c-97b3-d3b159b489b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:42.398179 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbf6a0-f1d0-4a0c-97b3-d3b159b489b9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:42.398688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbf6a0-f1d0-4a0c-97b3-d3b159b489b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:42.399095 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbf6a0-f1d0-4a0c-97b3-d3b159b489b9 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:42.399958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dbf6a0-f1d0-4a0c-97b3-d3b159b489b9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:42.400397 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dbf6a0-f1d0-4a0c-97b3-d3b159b489b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:42.401991 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dbf6a0-f1d0-4a0c-97b3-d3b159b489b9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:42.402959 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678eb12-70cc-4615-9060-863973524bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:42.403552 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678eb12-70cc-4615-9060-863973524bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:42.403828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678eb12-70cc-4615-9060-863973524bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:42.404095 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678eb12-70cc-4615-9060-863973524bb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:42.404845 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678eb12-70cc-4615-9060-863973524bb8 None admin] RBAC: Adding query filter params (role.id=38bb7e6ed5854439aeaf5996eb6892f6, scope.project.id=783c362712d34405ab827e3f00a67995, user.id=893e204cfff74570b3226b2e8c47df57) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:42.405149 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678eb12-70cc-4615-9060-863973524bb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:42.406540 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678eb12-70cc-4615-9060-863973524bb8 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:42.412324 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 343/669] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:26:42 2022] GET /identity/v3/role_assignments?user.id=893e204cfff74570b3226b2e8c47df57&scope.project.id=783c362712d34405ab827e3f00a67995&role.id=38bb7e6ed5854439aeaf5996eb6892f6 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:42.413165 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678eb12-70cc-4615-9060-863973524bb8 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:42.433866 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 327/670] 10.222.0.62 () {56 vars in 1139 bytes} [Mon Aug 22 20:26:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:42.435115 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbf6a0-f1d0-4a0c-97b3-d3b159b489b9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:42.518264 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:42.520551 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:42.548268 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678eb12-70cc-4615-9060-863973524bb8 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:42.568001 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbf6a0-f1d0-4a0c-97b3-d3b159b489b9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:42.598963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecfc88-5adc-4f44-99d4-23509ad0667a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:42.600358 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecfc88-5adc-4f44-99d4-23509ad0667a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:42.600871 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecfc88-5adc-4f44-99d4-23509ad0667a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:42.601211 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecfc88-5adc-4f44-99d4-23509ad0667a None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:42.602039 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ecfc88-5adc-4f44-99d4-23509ad0667a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:42.602426 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ecfc88-5adc-4f44-99d4-23509ad0667a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:42.604289 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ecfc88-5adc-4f44-99d4-23509ad0667a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:42.612216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e060866-884a-4319-81be-7d6c65133b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:42.613062 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e060866-884a-4319-81be-7d6c65133b2b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:42.613340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e060866-884a-4319-81be-7d6c65133b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:42.613608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e060866-884a-4319-81be-7d6c65133b2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:42.617060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 344/671] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:42.617969 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecfc88-5adc-4f44-99d4-23509ad0667a None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:42.626131 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e060866-884a-4319-81be-7d6c65133b2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:42.629028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e060866-884a-4319-81be-7d6c65133b2b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:42.649874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-3e060866-884a-4319-81be-7d6c65133b2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:42.649874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:42.649874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:42.649874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:42.649874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:42.649874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:42.649874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:42.649874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:42.649874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:42.649874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:42.649874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:42.649874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:42.649874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:42.649874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:42.649874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:42.649874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:42.650871 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:42.650871 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:42.650871 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:42.650871 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:42.650871 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:42.650871 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:42.650871 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:42.650871 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:42.650871 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:42.650871 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:42.650871 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:42.650871 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:42.650871 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:42.650871 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:42.650871 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:42.650871 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:42.650871 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:42.651901 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:42.651901 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:42.651901 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:42.651901 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 328/672] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:42.651901 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e060866-884a-4319-81be-7d6c65133b2b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:42.738955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecfc88-5adc-4f44-99d4-23509ad0667a None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:42.773433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e060866-884a-4319-81be-7d6c65133b2b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:42.777723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a1e13-c5f7-4cb5-8cf9-dd87795db08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:42.778427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a1e13-c5f7-4cb5-8cf9-dd87795db08d None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:42.778802 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a1e13-c5f7-4cb5-8cf9-dd87795db08d None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:42.779170 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a1e13-c5f7-4cb5-8cf9-dd87795db08d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:42.795381 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:42.797058 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:42.814226 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d78966-d0dd-46ac-8775-157e57f27b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:42.814857 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d78966-d0dd-46ac-8775-157e57f27b12 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:42.815133 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d78966-d0dd-46ac-8775-157e57f27b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:42.815402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d78966-d0dd-46ac-8775-157e57f27b12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:42.822950 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d78966-d0dd-46ac-8775-157e57f27b12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:42.824814 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d78966-d0dd-46ac-8775-157e57f27b12 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:42.837786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-74d78966-d0dd-46ac-8775-157e57f27b12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:42.837786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:42.837786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:42.837786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:42.837786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:42.837786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:42.837786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:42.837786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:42.837786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:42.837786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:42.837786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:42.837786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:42.837786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:26:42.837786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:26:42.837786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:26:42.839135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:26:42.839135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:42.839135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:42.839135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:42.839135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:42.839135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:42.839135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:42.839135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:42.839135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:42.839135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:42.839135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:42.839135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:42.839135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:42.839135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:42.839135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:42.839135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:42.839135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:42.840403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:26:42.840403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:26:42.840403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:26:42.840403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:26:42.840403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:26:42.840403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:26:42.840403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:42.840403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:42.840403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 329/673] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:26:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:42.840403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d78966-d0dd-46ac-8775-157e57f27b12 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:42.871769 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a1e13-c5f7-4cb5-8cf9-dd87795db08d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:42.873820 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a1e13-c5f7-4cb5-8cf9-dd87795db08d None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:42.953415 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d78966-d0dd-46ac-8775-157e57f27b12 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:42.991291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81382a-68ac-4833-9be3-db01c77a0979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:42.992001 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81382a-68ac-4833-9be3-db01c77a0979 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:42.992351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81382a-68ac-4833-9be3-db01c77a0979 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:42.992722 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81382a-68ac-4833-9be3-db01c77a0979 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:42.993439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81382a-68ac-4833-9be3-db01c77a0979 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:42.993809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81382a-68ac-4833-9be3-db01c77a0979 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:42.995251 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81382a-68ac-4833-9be3-db01c77a0979 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:43.010666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 345/674] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:26:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:26:43.012691 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a1e13-c5f7-4cb5-8cf9-dd87795db08d None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:43.022359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 330/675] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:43.023405 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81382a-68ac-4833-9be3-db01c77a0979 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:43.070867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:43.073669 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:43.145298 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a1e13-c5f7-4cb5-8cf9-dd87795db08d None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:43.162855 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81382a-68ac-4833-9be3-db01c77a0979 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:43.189209 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e7215-2da6-4256-9250-5dd6439ed41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:43.189819 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e7215-2da6-4256-9250-5dd6439ed41a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:43.190099 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e7215-2da6-4256-9250-5dd6439ed41a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:43.190526 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e7215-2da6-4256-9250-5dd6439ed41a None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:43.191927 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e7215-2da6-4256-9250-5dd6439ed41a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:43.192374 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e7215-2da6-4256-9250-5dd6439ed41a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:43.194107 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e7215-2da6-4256-9250-5dd6439ed41a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:43.199292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04c09c-a9a7-46d8-8b11-c2e005627dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:43.199926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04c09c-a9a7-46d8-8b11-c2e005627dc8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:43.200202 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04c09c-a9a7-46d8-8b11-c2e005627dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:43.200475 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04c09c-a9a7-46d8-8b11-c2e005627dc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:43.208435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 346/676] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 22 20:26:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:43.213370 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e7215-2da6-4256-9250-5dd6439ed41a None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:43.217647 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04c09c-a9a7-46d8-8b11-c2e005627dc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:43.219164 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04c09c-a9a7-46d8-8b11-c2e005627dc8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:43.236340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-ae04c09c-a9a7-46d8-8b11-c2e005627dc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:43.236340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:43.236340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:43.236340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:43.236340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:43.236340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:43.236340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:43.236340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:43.236340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:43.236340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:43.236340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:43.236340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:43.236340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:43.236340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:43.236340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:43.236340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:43.238735 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:43.238735 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:43.238735 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:43.238735 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:43.238735 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:43.238735 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:43.238735 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:43.238735 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:43.238735 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:43.238735 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:43.238735 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:43.238735 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:43.238735 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:43.238735 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:43.238735 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:43.238735 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:43.238735 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:43.240956 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:43.240956 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:43.240956 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:43.240956 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 331/677] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:43.240956 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04c09c-a9a7-46d8-8b11-c2e005627dc8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:43.343193 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e7215-2da6-4256-9250-5dd6439ed41a None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:43.344938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:43.356899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:43.369798 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04c09c-a9a7-46d8-8b11-c2e005627dc8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:43.389237 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bf214-cb17-4549-ac0d-37c886ba33ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:43.389957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bf214-cb17-4549-ac0d-37c886ba33ce None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:43.390232 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bf214-cb17-4549-ac0d-37c886ba33ce None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:43.390500 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bf214-cb17-4549-ac0d-37c886ba33ce None admin] PATH_INFO: `/v3/users/swift` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:43.401126 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bf214-cb17-4549-ac0d-37c886ba33ce None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:43.402960 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bf214-cb17-4549-ac0d-37c886ba33ce None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:43.405464 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51d30d-78c3-46c8-9409-73d853623188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:43.406076 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51d30d-78c3-46c8-9409-73d853623188 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:43.406355 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51d30d-78c3-46c8-9409-73d853623188 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:43.406628 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51d30d-78c3-46c8-9409-73d853623188 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:43.407352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e51d30d-78c3-46c8-9409-73d853623188 None admin] RBAC: Adding query filter params (role.id=38bb7e6ed5854439aeaf5996eb6892f6, scope.project.id=783c362712d34405ab827e3f00a67995, user.id=d4e298bcbaf84866b4fc6c6f65216fc5) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:43.407659 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e51d30d-78c3-46c8-9409-73d853623188 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:43.409194 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e51d30d-78c3-46c8-9409-73d853623188 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:43.416509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 332/678] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:26:43 2022] GET /identity/v3/role_assignments?user.id=d4e298bcbaf84866b4fc6c6f65216fc5&scope.project.id=783c362712d34405ab827e3f00a67995&role.id=38bb7e6ed5854439aeaf5996eb6892f6 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:43.417420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51d30d-78c3-46c8-9409-73d853623188 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:43.420778 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-524bf214-cb17-4549-ac0d-37c886ba33ce None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 20:26:43.420778 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:43.420778 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:43.420778 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:43.420778 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:43.420778 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:43.420778 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:43.420778 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:43.420778 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:43.420778 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:43.420778 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:43.420778 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:43.420778 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:26:43.420778 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:26:43.420778 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:26:43.420778 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:26:43.423359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:43.423359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:43.423359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:26:43.423359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:43.423359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:26:43.423359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:43.423359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:43.423359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:43.423359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:43.423359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:43.423359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:43.423359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:43.423359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:43.423359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:43.423359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:43.423359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:43.423359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:43.423359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:43.427756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:43.427756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:43.427756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:26:43.427756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:26:43.427756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:26:43.427756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:26:43.427756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:26:43.427756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:26:43.427756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 20:26:43.427756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:43.427756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 347/679] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 22 20:26:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:43.436698 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bf214-cb17-4549-ac0d-37c886ba33ce None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:43.578449 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51d30d-78c3-46c8-9409-73d853623188 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:43.621017 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bf214-cb17-4549-ac0d-37c886ba33ce None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:43.623548 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfc4bf-6e7f-427f-884e-353dc8592955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:43.625035 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfc4bf-6e7f-427f-884e-353dc8592955 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:43.625320 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfc4bf-6e7f-427f-884e-353dc8592955 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:43.625596 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfc4bf-6e7f-427f-884e-353dc8592955 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:43.626262 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfc4bf-6e7f-427f-884e-353dc8592955 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:43.626537 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfc4bf-6e7f-427f-884e-353dc8592955 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:43.627925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfc4bf-6e7f-427f-884e-353dc8592955 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:43.645217 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 333/680] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:43.646629 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6debea-5d80-4959-b654-501dd9ae9fda None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:43.646914 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6debea-5d80-4959-b654-501dd9ae9fda None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:43.647184 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6debea-5d80-4959-b654-501dd9ae9fda None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:43.653046 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 334/681] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:43.653046 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6debea-5d80-4959-b654-501dd9ae9fda None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:43.678032 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ecc231-2449-44e7-ba19-6c65927572e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:43.678647 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecc231-2449-44e7-ba19-6c65927572e4 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:43.678931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecc231-2449-44e7-ba19-6c65927572e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:43.679206 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecc231-2449-44e7-ba19-6c65927572e4 None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:43.679939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ecc231-2449-44e7-ba19-6c65927572e4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:43.680530 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ecc231-2449-44e7-ba19-6c65927572e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:43.681787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ecc231-2449-44e7-ba19-6c65927572e4 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:43.708491 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 348/682] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Aug 22 20:26:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:43.711146 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d4fb6-d48c-407a-9f0b-ff26ffd02ad1 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:43.711146 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d4fb6-d48c-407a-9f0b-ff26ffd02ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:43.711146 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d4fb6-d48c-407a-9f0b-ff26ffd02ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:43.715170 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:43.730131 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-818d4fb6-d48c-407a-9f0b-ff26ffd02ad1 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:43.731344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-818d4fb6-d48c-407a-9f0b-ff26ffd02ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:43.748612 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:43.792220 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6debea-5d80-4959-b654-501dd9ae9fda None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:43.809941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 349/683] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:43.810793 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d4fb6-d48c-407a-9f0b-ff26ffd02ad1 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:43.846929 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187bac9d-73ac-4b9d-9dd1-5ca621d3b52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:43.847798 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187bac9d-73ac-4b9d-9dd1-5ca621d3b52d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:43.848080 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187bac9d-73ac-4b9d-9dd1-5ca621d3b52d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:43.848351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187bac9d-73ac-4b9d-9dd1-5ca621d3b52d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:43.859452 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187bac9d-73ac-4b9d-9dd1-5ca621d3b52d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:43.860945 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187bac9d-73ac-4b9d-9dd1-5ca621d3b52d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:43.885477 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-187bac9d-73ac-4b9d-9dd1-5ca621d3b52d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:43.885477 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:43.885477 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:43.885477 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:43.885477 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:43.885477 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:43.885477 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:43.885477 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:43.885477 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:43.885477 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:43.885477 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:43.885477 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:43.885477 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:26:43.885477 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:26:43.885477 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:26:43.886424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:26:43.886424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:43.886424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:43.886424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:43.886424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:43.886424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:43.886424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:43.886424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:43.886424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:43.886424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:43.886424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:43.886424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:43.886424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:43.886424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:43.886424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:43.886424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:43.886424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:43.887296 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:26:43.887296 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:26:43.887296 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:26:43.887296 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:26:43.887296 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:26:43.887296 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:26:43.887296 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:43.887296 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:43.887296 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 335/684] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:26:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:43.892165 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187bac9d-73ac-4b9d-9dd1-5ca621d3b52d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:43.914347 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d4fb6-d48c-407a-9f0b-ff26ffd02ad1 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:43.961127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc4bd9-e0be-4106-9bf2-9588b7681b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:43.961739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc4bd9-e0be-4106-9bf2-9588b7681b41 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:43.962014 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc4bd9-e0be-4106-9bf2-9588b7681b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:43.964688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc4bd9-e0be-4106-9bf2-9588b7681b41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:44.013962 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:44.039843 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187bac9d-73ac-4b9d-9dd1-5ca621d3b52d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:44.047569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:44.075620 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d833b-d7f3-4413-a96f-7d5d8f79ecb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:44.084681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d833b-d7f3-4413-a96f-7d5d8f79ecb0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:44.084681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d833b-d7f3-4413-a96f-7d5d8f79ecb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:44.084681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d833b-d7f3-4413-a96f-7d5d8f79ecb0 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:44.084681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d833b-d7f3-4413-a96f-7d5d8f79ecb0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:44.084681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d833b-d7f3-4413-a96f-7d5d8f79ecb0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:44.086830 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d833b-d7f3-4413-a96f-7d5d8f79ecb0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:44.104099 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc4bd9-e0be-4106-9bf2-9588b7681b41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:44.105582 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc4bd9-e0be-4106-9bf2-9588b7681b41 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:44.120913 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 336/685] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 22 20:26:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:26:44.126993 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d833b-d7f3-4413-a96f-7d5d8f79ecb0 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:44.242018 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 350/686] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:26:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:26:44.242789 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc4bd9-e0be-4106-9bf2-9588b7681b41 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:44.257297 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d833b-d7f3-4413-a96f-7d5d8f79ecb0 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:44.293327 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:44.295115 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2bd2be-3c17-40fb-9979-269f07267057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:44.295911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2bd2be-3c17-40fb-9979-269f07267057 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:44.296416 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2bd2be-3c17-40fb-9979-269f07267057 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:44.296894 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2bd2be-3c17-40fb-9979-269f07267057 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:44.297783 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2bd2be-3c17-40fb-9979-269f07267057 None admin] RBAC: Adding query filter params (role.id=38bb7e6ed5854439aeaf5996eb6892f6, scope.project.id=783c362712d34405ab827e3f00a67995, user.id=538ba8188ed540628242c983ebd6dd1f) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:44.298240 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2bd2be-3c17-40fb-9979-269f07267057 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:44.299829 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2bd2be-3c17-40fb-9979-269f07267057 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:44.307216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:44.307903 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 337/687] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:26:44 2022] GET /identity/v3/role_assignments?user.id=538ba8188ed540628242c983ebd6dd1f&scope.project.id=783c362712d34405ab827e3f00a67995&role.id=38bb7e6ed5854439aeaf5996eb6892f6 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:44.309043 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2bd2be-3c17-40fb-9979-269f07267057 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:44.348770 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc4bd9-e0be-4106-9bf2-9588b7681b41 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:44.414753 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3dfc2-2ab9-4981-a03b-a606788fc5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:44.415744 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3dfc2-2ab9-4981-a03b-a606788fc5cb None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:44.416193 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3dfc2-2ab9-4981-a03b-a606788fc5cb None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:44.416619 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3dfc2-2ab9-4981-a03b-a606788fc5cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:44.446056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3dfc2-2ab9-4981-a03b-a606788fc5cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:44.454960 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-fff3dfc2-2ab9-4981-a03b-a606788fc5cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:26:44.454960 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:44.454960 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:44.454960 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:44.454960 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:44.454960 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:44.454960 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:44.454960 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:44.454960 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:44.454960 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:44.454960 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:44.454960 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:44.454960 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:44.454960 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:44.454960 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:44.454960 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:44.456689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:44.456689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:44.456689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:44.456689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:44.456689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:44.456689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:44.456689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:44.456689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:44.456689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:44.456689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:44.456689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:44.456689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:44.456689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:44.456689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:44.456689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:44.456689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:44.457559 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:44.457559 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:44.457559 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:44.457559 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:44.457559 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:44.457559 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:44.457559 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:44.457559 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:44.457559 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:44.457559 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:44.457559 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:26:44.457559 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:44.461623 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 351/688] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 22 20:26:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:44.465127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3dfc2-2ab9-4981-a03b-a606788fc5cb None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:44.492215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2bd2be-3c17-40fb-9979-269f07267057 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:44.529237 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ccae6-e018-4a2d-853a-4621e952e617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:44.529877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ccae6-e018-4a2d-853a-4621e952e617 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:44.530159 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ccae6-e018-4a2d-853a-4621e952e617 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:44.530508 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ccae6-e018-4a2d-853a-4621e952e617 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:44.542163 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ccae6-e018-4a2d-853a-4621e952e617 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:44.543627 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ccae6-e018-4a2d-853a-4621e952e617 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:44.558999 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-5d1ccae6-e018-4a2d-853a-4621e952e617 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:44.558999 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:44.558999 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:44.558999 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:44.558999 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:44.558999 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:44.558999 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:44.558999 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:44.558999 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:44.558999 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:44.558999 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:44.558999 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:44.558999 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:44.558999 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:44.558999 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:44.558999 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:44.560220 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:44.560220 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:44.560220 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:44.560220 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:44.560220 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:44.560220 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:44.560220 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:44.560220 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:44.560220 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:44.560220 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:44.560220 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:44.560220 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:44.560220 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:44.560220 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:44.560220 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:44.560220 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:44.560220 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:44.561563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:44.561563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:44.561563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:44.561563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 338/689] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:44.566054 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ccae6-e018-4a2d-853a-4621e952e617 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:44.593762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3dfc2-2ab9-4981-a03b-a606788fc5cb None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:44.606851 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:44.622101 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:44.635492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822639b5-7be3-4bf7-8169-bc3289e2787c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:44.636320 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822639b5-7be3-4bf7-8169-bc3289e2787c None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:44.636781 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822639b5-7be3-4bf7-8169-bc3289e2787c None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:44.637200 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822639b5-7be3-4bf7-8169-bc3289e2787c None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:44.638010 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822639b5-7be3-4bf7-8169-bc3289e2787c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:44.638487 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822639b5-7be3-4bf7-8169-bc3289e2787c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:44.640180 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822639b5-7be3-4bf7-8169-bc3289e2787c None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:44.650312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 352/690] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:26:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:26:44.651846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172eed8-9d8a-4a1e-8ee9-922e62286bc8 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:44.652190 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172eed8-9d8a-4a1e-8ee9-922e62286bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:44.652470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172eed8-9d8a-4a1e-8ee9-922e62286bc8 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:44.653830 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 353/691] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:44.657966 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172eed8-9d8a-4a1e-8ee9-922e62286bc8 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:44.684772 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ccae6-e018-4a2d-853a-4621e952e617 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:44.734636 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2ffa7-199e-4462-bbf2-ae2948532939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:44.735351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2ffa7-199e-4462-bbf2-ae2948532939 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:44.735710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2ffa7-199e-4462-bbf2-ae2948532939 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:44.736046 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2ffa7-199e-4462-bbf2-ae2948532939 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:44.736798 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2ffa7-199e-4462-bbf2-ae2948532939 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:44.737172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2ffa7-199e-4462-bbf2-ae2948532939 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:44.742013 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2ffa7-199e-4462-bbf2-ae2948532939 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:44.756417 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 339/692] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:26:44.758058 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0f48d-9e21-41d8-80d3-ba005375db12 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:44.758505 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0f48d-9e21-41d8-80d3-ba005375db12 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:44.758937 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0f48d-9e21-41d8-80d3-ba005375db12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:44.777608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-62b0f48d-9e21-41d8-80d3-ba005375db12 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:44.780676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-62b0f48d-9e21-41d8-80d3-ba005375db12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:44.801021 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172eed8-9d8a-4a1e-8ee9-922e62286bc8 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:44.851655 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba236a4-f6b6-43d6-ad7c-8b2598637536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:44.853241 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba236a4-f6b6-43d6-ad7c-8b2598637536 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:44.854032 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba236a4-f6b6-43d6-ad7c-8b2598637536 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:44.854514 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba236a4-f6b6-43d6-ad7c-8b2598637536 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:44.869589 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba236a4-f6b6-43d6-ad7c-8b2598637536 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:44.872038 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba236a4-f6b6-43d6-ad7c-8b2598637536 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:44.878534 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 340/693] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:44.879572 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0f48d-9e21-41d8-80d3-ba005375db12 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:44.892939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-aba236a4-f6b6-43d6-ad7c-8b2598637536 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:44.892939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:44.892939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:44.892939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:44.892939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:44.892939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:44.892939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:44.892939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:44.892939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:44.892939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:44.892939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:44.892939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:44.892939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:44.892939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:44.892939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:44.892939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:44.894239 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:44.894239 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:44.894239 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:44.894239 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:44.894239 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:44.894239 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:44.894239 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:44.894239 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:44.894239 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:44.894239 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:44.894239 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:44.894239 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:44.894239 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:44.894239 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:44.894239 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:44.894239 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:44.894239 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:44.895273 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:44.895273 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:44.895273 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:44.897420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 354/694] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:44.910272 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba236a4-f6b6-43d6-ad7c-8b2598637536 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:44.936475 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:44.954454 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:45.000582 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0f48d-9e21-41d8-80d3-ba005375db12 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:45.061578 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c63d3-4049-43fb-b6d1-37325cb19520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:45.062595 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c63d3-4049-43fb-b6d1-37325cb19520 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:45.063080 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c63d3-4049-43fb-b6d1-37325cb19520 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:45.063608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c63d3-4049-43fb-b6d1-37325cb19520 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:45.071710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c63d3-4049-43fb-b6d1-37325cb19520 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:45.073464 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c63d3-4049-43fb-b6d1-37325cb19520 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:45.088349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-ea6c63d3-4049-43fb-b6d1-37325cb19520 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:45.088349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:45.088349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:45.088349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:45.088349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:45.088349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:45.088349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:45.088349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:45.088349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:45.088349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:45.088349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:45.088349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:45.088349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:26:45.088349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:26:45.088349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:26:45.089297 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:26:45.089297 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:45.089297 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:45.089297 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:45.089297 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:45.089297 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:45.089297 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:45.089297 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:45.089297 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:45.089297 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:45.089297 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:45.089297 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:45.089297 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:45.089297 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:45.089297 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:45.089297 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:45.089297 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:45.090195 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:26:45.090195 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:26:45.090195 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:26:45.090195 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:26:45.090195 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:26:45.090195 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:26:45.090195 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:45.090195 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:45.092584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 341/695] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:26:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:45.099684 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c63d3-4049-43fb-b6d1-37325cb19520 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:45.139051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba236a4-f6b6-43d6-ad7c-8b2598637536 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:45.198461 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00d75c-951d-41e6-8149-9e421e9f6c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:45.199071 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00d75c-951d-41e6-8149-9e421e9f6c9d None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:45.199353 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00d75c-951d-41e6-8149-9e421e9f6c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:45.199628 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00d75c-951d-41e6-8149-9e421e9f6c9d None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:45.200276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd00d75c-951d-41e6-8149-9e421e9f6c9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:45.200580 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd00d75c-951d-41e6-8149-9e421e9f6c9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:45.202253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd00d75c-951d-41e6-8149-9e421e9f6c9d None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:45.218784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 355/696] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:45.218784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00d75c-951d-41e6-8149-9e421e9f6c9d None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:45.244498 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c63d3-4049-43fb-b6d1-37325cb19520 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:45.257845 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:45.282311 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484a574-5a4a-40b8-9988-9f14aa92acbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:45.283125 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484a574-5a4a-40b8-9988-9f14aa92acbd None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:45.283500 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484a574-5a4a-40b8-9988-9f14aa92acbd None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:45.283886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484a574-5a4a-40b8-9988-9f14aa92acbd None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:45.284743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8484a574-5a4a-40b8-9988-9f14aa92acbd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:45.285155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8484a574-5a4a-40b8-9988-9f14aa92acbd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:45.286897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8484a574-5a4a-40b8-9988-9f14aa92acbd None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:45.306525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 342/697] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 22 20:26:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:45.306525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484a574-5a4a-40b8-9988-9f14aa92acbd None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:45.321839 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:45.342917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00d75c-951d-41e6-8149-9e421e9f6c9d None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:45.383488 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7270a-bd65-4234-9a1b-018f29c4fc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:45.384440 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7270a-bd65-4234-9a1b-018f29c4fc5b None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:45.384939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7270a-bd65-4234-9a1b-018f29c4fc5b None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:45.385570 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7270a-bd65-4234-9a1b-018f29c4fc5b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:45.386460 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7270a-bd65-4234-9a1b-018f29c4fc5b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:45.388291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7270a-bd65-4234-9a1b-018f29c4fc5b None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:45.400208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-eda7270a-bd65-4234-9a1b-018f29c4fc5b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 20:26:45.400208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:45.400208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:26:45.400208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:26:45.400208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:26:45.400208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:26:45.400208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:26:45.400208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:26:45.400208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 20:26:45.400208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:45.400208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:26:45.400208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:45.400208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:45.400208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:45.400208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:45.400208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:45.400208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:45.401333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:45.401333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:45.401333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:45.401333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:45.401333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:45.401333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:45.401333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:26:45.401333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:26:45.401333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:26:45.401333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:26:45.401333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:45.401333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:45.401333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:45.401333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:45.401333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:45.401333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:45.402164 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:45.402164 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:45.402164 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:45.402164 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:45.402164 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:45.402164 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:45.402164 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:45.402164 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:45.402164 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:45.402164 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:45.402164 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:26:45.402164 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:26:45.402164 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 20:26:45.402164 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:45.405172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 356/698] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Aug 22 20:26:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:45.406330 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7270a-bd65-4234-9a1b-018f29c4fc5b None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:45.435925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484a574-5a4a-40b8-9988-9f14aa92acbd None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:45.477765 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396139ad-cc64-4e32-b2a3-69fff8598d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:45.478813 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396139ad-cc64-4e32-b2a3-69fff8598d9f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:45.479296 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396139ad-cc64-4e32-b2a3-69fff8598d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:45.479765 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396139ad-cc64-4e32-b2a3-69fff8598d9f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:45.489688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396139ad-cc64-4e32-b2a3-69fff8598d9f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:45.491445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396139ad-cc64-4e32-b2a3-69fff8598d9f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:45.504479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-396139ad-cc64-4e32-b2a3-69fff8598d9f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:26:45.504479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:45.504479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:45.504479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:45.504479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:45.504479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:45.504479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:45.504479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:45.504479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:45.504479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:45.504479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:45.504479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:45.504479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:26:45.504479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:26:45.504479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:26:45.504479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:26:45.505599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:45.505599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:45.505599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:26:45.505599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:45.505599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:26:45.505599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:45.505599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:45.505599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:45.505599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:45.505599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:45.505599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:45.505599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:45.505599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:45.505599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:45.505599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:45.505599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:45.505599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:45.505599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:45.506573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:45.506573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:45.506573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:26:45.506573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:26:45.506573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:26:45.506573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:26:45.506573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:26:45.506573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:26:45.506573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:26:45.506573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:45.509237 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 343/699] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Aug 22 20:26:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:45.510390 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396139ad-cc64-4e32-b2a3-69fff8598d9f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:45.537917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:45.539460 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7270a-bd65-4234-9a1b-018f29c4fc5b None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:45.582464 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74941b5c-1c8a-493f-9ef3-152a893a78e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:45.583822 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74941b5c-1c8a-493f-9ef3-152a893a78e8 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:45.584307 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74941b5c-1c8a-493f-9ef3-152a893a78e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:45.584878 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74941b5c-1c8a-493f-9ef3-152a893a78e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:45.585937 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74941b5c-1c8a-493f-9ef3-152a893a78e8 None admin] RBAC: Adding query filter params (role.id=38bb7e6ed5854439aeaf5996eb6892f6, scope.project.id=783c362712d34405ab827e3f00a67995, user.id=907607fd209b416ba9b68512772c1d17) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:45.586479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74941b5c-1c8a-493f-9ef3-152a893a78e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:45.588177 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74941b5c-1c8a-493f-9ef3-152a893a78e8 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:45.595439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 357/700] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:26:45 2022] GET /identity/v3/role_assignments?user.id=907607fd209b416ba9b68512772c1d17&scope.project.id=783c362712d34405ab827e3f00a67995&role.id=38bb7e6ed5854439aeaf5996eb6892f6 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:45.597248 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74941b5c-1c8a-493f-9ef3-152a893a78e8 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:45.615370 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:45.638268 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396139ad-cc64-4e32-b2a3-69fff8598d9f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:45.678546 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8efb5a7-02fc-42cf-850d-5d955993f285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:45.679181 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efb5a7-02fc-42cf-850d-5d955993f285 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:45.679459 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efb5a7-02fc-42cf-850d-5d955993f285 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:45.679728 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efb5a7-02fc-42cf-850d-5d955993f285 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:45.680413 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8efb5a7-02fc-42cf-850d-5d955993f285 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:45.680741 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8efb5a7-02fc-42cf-850d-5d955993f285 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:45.682215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8efb5a7-02fc-42cf-850d-5d955993f285 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:45.687408 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 344/701] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Aug 22 20:26:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:45.693786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8efb5a7-02fc-42cf-850d-5d955993f285 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:45.718172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74941b5c-1c8a-493f-9ef3-152a893a78e8 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:45.760855 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e9299-8b23-400d-9405-8533516b3606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:45.761913 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e9299-8b23-400d-9405-8533516b3606 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:45.762408 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e9299-8b23-400d-9405-8533516b3606 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:45.762788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e9299-8b23-400d-9405-8533516b3606 None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:45.763642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e9299-8b23-400d-9405-8533516b3606 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:45.764053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e9299-8b23-400d-9405-8533516b3606 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:45.765888 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e9299-8b23-400d-9405-8533516b3606 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:45.792693 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 358/702] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Aug 22 20:26:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:45.792693 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243bf602-5efd-499b-a8c9-aff7c0f2f2f1 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:45.792693 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243bf602-5efd-499b-a8c9-aff7c0f2f2f1 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:45.792693 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243bf602-5efd-499b-a8c9-aff7c0f2f2f1 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:45.792693 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 359/703] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:45.796947 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243bf602-5efd-499b-a8c9-aff7c0f2f2f1 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:45.827721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:45.844629 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8efb5a7-02fc-42cf-850d-5d955993f285 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:45.880633 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:45.886726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90bad2-faba-4fc0-9a54-880200081ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:45.887345 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90bad2-faba-4fc0-9a54-880200081ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:45.887626 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90bad2-faba-4fc0-9a54-880200081ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:45.887900 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90bad2-faba-4fc0-9a54-880200081ac4 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:45.888761 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc90bad2-faba-4fc0-9a54-880200081ac4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:45.889153 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc90bad2-faba-4fc0-9a54-880200081ac4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:45.890660 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc90bad2-faba-4fc0-9a54-880200081ac4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:45.898942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 345/704] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Aug 22 20:26:45 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:45.899737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154e6c6-8f36-4426-b2f4-852977569f24 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:45.900032 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154e6c6-8f36-4426-b2f4-852977569f24 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:45.900308 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154e6c6-8f36-4426-b2f4-852977569f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:45.923570 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-d154e6c6-8f36-4426-b2f4-852977569f24 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:45.926571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d154e6c6-8f36-4426-b2f4-852977569f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:45.952844 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243bf602-5efd-499b-a8c9-aff7c0f2f2f1 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:45.993936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11b433-a04e-4d4a-a3dc-bfe47fcff4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:45.994985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11b433-a04e-4d4a-a3dc-bfe47fcff4af None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:45.995481 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11b433-a04e-4d4a-a3dc-bfe47fcff4af None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:45.995985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11b433-a04e-4d4a-a3dc-bfe47fcff4af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:46.010578 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 346/705] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:46.078467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11b433-a04e-4d4a-a3dc-bfe47fcff4af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:46.080303 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11b433-a04e-4d4a-a3dc-bfe47fcff4af None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:46.170612 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:46.215047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 360/706] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:26:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 20:26:46.220509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154e6c6-8f36-4426-b2f4-852977569f24 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:46.339548 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:46.360227 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154e6c6-8f36-4426-b2f4-852977569f24 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:46.400269 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8479846-992f-4bf0-995d-e61829e69187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:46.401297 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8479846-992f-4bf0-995d-e61829e69187 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:46.401813 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8479846-992f-4bf0-995d-e61829e69187 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:46.401920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11b433-a04e-4d4a-a3dc-bfe47fcff4af None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:46.402381 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8479846-992f-4bf0-995d-e61829e69187 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:46.414253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8479846-992f-4bf0-995d-e61829e69187 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:46.416062 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8479846-992f-4bf0-995d-e61829e69187 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:46.433729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-d8479846-992f-4bf0-995d-e61829e69187 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:46.433729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:46.433729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:46.433729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:46.433729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:46.433729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:46.433729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:46.433729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:46.433729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:46.433729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:46.433729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:46.433729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:46.433729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:46.433729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:46.433729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:46.433729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:46.434674 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:46.434674 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:46.434674 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:46.434674 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:46.434674 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:46.434674 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:46.434674 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:46.434674 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:46.434674 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:46.434674 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:46.434674 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:46.434674 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:46.434674 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:46.434674 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:46.434674 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:46.434674 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:46.434674 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:46.435549 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:46.435549 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:46.435549 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:46.437109 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 347/707] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:46.443020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8479846-992f-4bf0-995d-e61829e69187 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:46.599844 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11b433-a04e-4d4a-a3dc-bfe47fcff4af None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:46.639490 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8479846-992f-4bf0-995d-e61829e69187 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:46.649872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38b35b-8070-43d0-8445-82d9fa51b9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:46.650510 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38b35b-8070-43d0-8445-82d9fa51b9fc None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:46.650783 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38b35b-8070-43d0-8445-82d9fa51b9fc None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:46.651053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38b35b-8070-43d0-8445-82d9fa51b9fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:46.666634 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38b35b-8070-43d0-8445-82d9fa51b9fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:46.668099 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38b35b-8070-43d0-8445-82d9fa51b9fc None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:46.697320 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-af38b35b-8070-43d0-8445-82d9fa51b9fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:46.697320 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:46.697320 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:46.697320 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:46.697320 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:46.697320 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:46.697320 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:46.697320 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:46.697320 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:46.697320 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:46.697320 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:46.697320 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:46.697320 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:46.697320 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:46.697320 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:46.697320 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:46.698306 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:46.698306 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:46.698306 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:46.698306 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:46.698306 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:46.698306 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:46.698306 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:46.698306 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:46.698306 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:46.698306 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:46.698306 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:46.698306 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:46.698306 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:46.698306 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:46.698306 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:46.698306 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:46.698306 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:46.699181 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:46.699181 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:46.699181 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:46.699181 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 361/708] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:46.699846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ec788-bfc9-4107-a4a1-985e1aa2a004 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:46.700111 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ec788-bfc9-4107-a4a1-985e1aa2a004 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:46.701918 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3ec788-bfc9-4107-a4a1-985e1aa2a004 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:46.702117 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 362/709] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:46.704241 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ec788-bfc9-4107-a4a1-985e1aa2a004 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:46.706679 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:46.713306 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b12806a-e9f7-4073-b43b-47a18ce156c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:46.713913 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12806a-e9f7-4073-b43b-47a18ce156c9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:46.719997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12806a-e9f7-4073-b43b-47a18ce156c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:46.719997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12806a-e9f7-4073-b43b-47a18ce156c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:46.719997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b12806a-e9f7-4073-b43b-47a18ce156c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:46.719997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b12806a-e9f7-4073-b43b-47a18ce156c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:46.719997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b12806a-e9f7-4073-b43b-47a18ce156c9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:46.730025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 348/710] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:26:46.731336 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f79a71-0278-427f-8e91-4a92108bd7fd None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:46.731620 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f79a71-0278-427f-8e91-4a92108bd7fd None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:46.731893 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f79a71-0278-427f-8e91-4a92108bd7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:46.736318 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:46.750869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-91f79a71-0278-427f-8e91-4a92108bd7fd None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:46.754374 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-91f79a71-0278-427f-8e91-4a92108bd7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:46.825750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 349/711] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:46.826926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f79a71-0278-427f-8e91-4a92108bd7fd None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:46.860480 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3ec788-bfc9-4107-a4a1-985e1aa2a004 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:46.926594 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d81433-d8cc-4ed6-ae37-5263ed9e90ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:46.927402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d81433-d8cc-4ed6-ae37-5263ed9e90ab None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:46.927681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d81433-d8cc-4ed6-ae37-5263ed9e90ab None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:46.927951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d81433-d8cc-4ed6-ae37-5263ed9e90ab None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:46.928597 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d81433-d8cc-4ed6-ae37-5263ed9e90ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:46.930009 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d81433-d8cc-4ed6-ae37-5263ed9e90ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:46.931391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d81433-d8cc-4ed6-ae37-5263ed9e90ab None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:46.955875 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 363/712] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:46.965133 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d81433-d8cc-4ed6-ae37-5263ed9e90ab None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:47.038585 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f79a71-0278-427f-8e91-4a92108bd7fd None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:47.082098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:47.089408 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:47.108055 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865dd11-e393-45f8-9401-5cc6bde2eca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:47.108779 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865dd11-e393-45f8-9401-5cc6bde2eca1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:47.109063 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865dd11-e393-45f8-9401-5cc6bde2eca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:47.109338 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865dd11-e393-45f8-9401-5cc6bde2eca1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:47.119688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865dd11-e393-45f8-9401-5cc6bde2eca1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:47.121272 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865dd11-e393-45f8-9401-5cc6bde2eca1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:47.139280 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d81433-d8cc-4ed6-ae37-5263ed9e90ab None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:47.149929 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-f865dd11-e393-45f8-9401-5cc6bde2eca1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:47.149929 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:47.149929 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:47.149929 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:47.149929 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:47.149929 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:47.149929 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:47.149929 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:47.149929 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:47.149929 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:47.149929 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:47.149929 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:47.149929 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:26:47.149929 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:26:47.149929 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:26:47.150892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:26:47.150892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:47.150892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:47.150892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:47.150892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:47.150892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:47.150892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:47.150892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:47.150892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:47.150892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:47.150892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:47.150892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:47.150892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:47.150892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:47.150892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:47.150892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:47.150892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:47.151807 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:26:47.151807 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:26:47.151807 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:26:47.151807 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:26:47.151807 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:26:47.151807 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:26:47.151807 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:47.151807 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:47.151807 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 350/713] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:26:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:47.159820 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865dd11-e393-45f8-9401-5cc6bde2eca1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:47.202255 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f7961-fe6f-4a69-8940-994981e614c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:47.203167 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f7961-fe6f-4a69-8940-994981e614c7 None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:47.203455 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f7961-fe6f-4a69-8940-994981e614c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:47.203731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f7961-fe6f-4a69-8940-994981e614c7 None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:47.204409 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f7961-fe6f-4a69-8940-994981e614c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:47.207341 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f7961-fe6f-4a69-8940-994981e614c7 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:47.276375 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865dd11-e393-45f8-9401-5cc6bde2eca1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:47.296565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 364/714] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Aug 22 20:26:46 2022] POST /identity/v3/users => generated 254 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:26:47.298376 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f7961-fe6f-4a69-8940-994981e614c7 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:47.339299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f22f4-7a65-4d68-b2fc-499dcacd8b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:47.339940 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f22f4-7a65-4d68-b2fc-499dcacd8b60 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:47.340269 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f22f4-7a65-4d68-b2fc-499dcacd8b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:47.340643 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f22f4-7a65-4d68-b2fc-499dcacd8b60 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:47.341291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f22f4-7a65-4d68-b2fc-499dcacd8b60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:47.341595 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f22f4-7a65-4d68-b2fc-499dcacd8b60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:47.343156 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f22f4-7a65-4d68-b2fc-499dcacd8b60 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:47.372356 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 351/715] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 22 20:26:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:47.378315 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f22f4-7a65-4d68-b2fc-499dcacd8b60 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:47.449983 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f7961-fe6f-4a69-8940-994981e614c7 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:47.467408 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:47.504556 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a30685-45b9-4e28-aacb-7e6fd1d96a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:47.505655 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a30685-45b9-4e28-aacb-7e6fd1d96a1b None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:47.506088 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a30685-45b9-4e28-aacb-7e6fd1d96a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:47.506506 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a30685-45b9-4e28-aacb-7e6fd1d96a1b None admin] PATH_INFO: `/v3/services/network` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:47.507515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a30685-45b9-4e28-aacb-7e6fd1d96a1b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:47.509797 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a30685-45b9-4e28-aacb-7e6fd1d96a1b None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:47.525910 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-49a30685-45b9-4e28-aacb-7e6fd1d96a1b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 20:26:47.525910 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:47.525910 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:26:47.525910 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:26:47.525910 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:26:47.525910 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:26:47.525910 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:26:47.525910 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:26:47.525910 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 20:26:47.525910 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:47.525910 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:26:47.525910 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:47.525910 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:47.525910 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:47.525910 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:47.525910 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:47.525910 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:47.526957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:47.526957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:47.526957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:47.526957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:47.526957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:47.526957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:47.526957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:26:47.526957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:26:47.526957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:26:47.526957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:26:47.526957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:47.526957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:47.526957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:47.526957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:47.526957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:47.526957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:47.527763 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:47.527763 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:47.527763 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:47.527763 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:47.527763 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:47.527763 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:47.527763 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:47.527763 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:47.527763 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:47.527763 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:47.527763 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:26:47.527763 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:26:47.527763 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 20:26:47.527763 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:47.527763 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 365/716] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:26:47 2022] GET /identity/v3/services/network => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:47.535602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a30685-45b9-4e28-aacb-7e6fd1d96a1b None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:47.549333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:47.562606 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f22f4-7a65-4d68-b2fc-499dcacd8b60 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:47.613939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437ade2-6c4d-4f55-862e-0246c65b651e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:47.614567 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437ade2-6c4d-4f55-862e-0246c65b651e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:47.615001 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437ade2-6c4d-4f55-862e-0246c65b651e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:47.615285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437ade2-6c4d-4f55-862e-0246c65b651e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:47.616152 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437ade2-6c4d-4f55-862e-0246c65b651e None admin] RBAC: Adding query filter params (role.id=e3faa0474c054da6bb4d8910a4e40bff, scope.project.id=783c362712d34405ab827e3f00a67995, user.id=9f1738f72b4848499cdf0ec6866c3c8f) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:47.616463 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437ade2-6c4d-4f55-862e-0246c65b651e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:47.618959 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437ade2-6c4d-4f55-862e-0246c65b651e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:47.626493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 352/717] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:26:47 2022] GET /identity/v3/role_assignments?user.id=9f1738f72b4848499cdf0ec6866c3c8f&scope.project.id=783c362712d34405ab827e3f00a67995&role.id=e3faa0474c054da6bb4d8910a4e40bff => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:47.655488 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a30685-45b9-4e28-aacb-7e6fd1d96a1b None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:47.698152 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed2862-c126-4c26-9378-25ff070d31d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:47.698780 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed2862-c126-4c26-9378-25ff070d31d9 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:47.699102 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed2862-c126-4c26-9378-25ff070d31d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:47.699389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed2862-c126-4c26-9378-25ff070d31d9 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:47.700036 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ed2862-c126-4c26-9378-25ff070d31d9 None admin] RBAC: Adding query filter params (name=network) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:47.700395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ed2862-c126-4c26-9378-25ff070d31d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:47.702096 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ed2862-c126-4c26-9378-25ff070d31d9 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:47.709118 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 366/718] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Aug 22 20:26:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:26:47.714824 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437ade2-6c4d-4f55-862e-0246c65b651e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:47.838626 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437ade2-6c4d-4f55-862e-0246c65b651e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:47.845979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:47.876198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69291d-76b6-4569-b5bb-a860947c962a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:47.876906 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69291d-76b6-4569-b5bb-a860947c962a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:47.877192 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69291d-76b6-4569-b5bb-a860947c962a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:47.877473 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69291d-76b6-4569-b5bb-a860947c962a None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:47.879545 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69291d-76b6-4569-b5bb-a860947c962a None admin] RBAC: Adding query filter params (type=network) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:47.879857 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69291d-76b6-4569-b5bb-a860947c962a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:47.881371 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69291d-76b6-4569-b5bb-a860947c962a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:47.886523 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 353/719] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Aug 22 20:26:47 2022] GET /identity/v3/services?type=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:48.064581 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6582aa-d054-4e83-ad23-7a1583aee86f None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:48.064980 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6582aa-d054-4e83-ad23-7a1583aee86f None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:48.065085 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6582aa-d054-4e83-ad23-7a1583aee86f None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:48.066792 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 367/720] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:48.072058 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f0947-53cd-4e7f-a51f-b9482b60c99d None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:48.072551 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f0947-53cd-4e7f-a51f-b9482b60c99d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:48.072628 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f0947-53cd-4e7f-a51f-b9482b60c99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:48.094495 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c87f0947-53cd-4e7f-a51f-b9482b60c99d None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:48.095704 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c87f0947-53cd-4e7f-a51f-b9482b60c99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:48.186715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 354/721] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:48.227951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3573bd-21cc-4425-9f22-049bfd61dc51 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:48.228294 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3573bd-21cc-4425-9f22-049bfd61dc51 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:48.228511 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3573bd-21cc-4425-9f22-049bfd61dc51 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:48.230170 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 368/722] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:48.235467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75df09-301d-4f1b-8a9a-41a2548dfdb0 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:48.235750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75df09-301d-4f1b-8a9a-41a2548dfdb0 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:48.236024 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75df09-301d-4f1b-8a9a-41a2548dfdb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:48.256611 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-6c75df09-301d-4f1b-8a9a-41a2548dfdb0 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:48.257827 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6c75df09-301d-4f1b-8a9a-41a2548dfdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:48.346249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 355/723] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:48.518047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3573bd-21cc-4425-9f22-049bfd61dc51 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:48.646826 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:48.671955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75df09-301d-4f1b-8a9a-41a2548dfdb0 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:48.692458 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3573bd-21cc-4425-9f22-049bfd61dc51 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:48.735260 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:48.764214 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9f120-8b7c-4c53-9a9a-1b8f6a5fa07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:48.764874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9f120-8b7c-4c53-9a9a-1b8f6a5fa07b None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:48.765155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9f120-8b7c-4c53-9a9a-1b8f6a5fa07b None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:48.765429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9f120-8b7c-4c53-9a9a-1b8f6a5fa07b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:48.787844 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9f120-8b7c-4c53-9a9a-1b8f6a5fa07b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:48.793817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-f1d9f120-8b7c-4c53-9a9a-1b8f6a5fa07b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:26:48.793817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:48.793817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:48.793817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:48.793817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:48.793817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:48.793817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:48.793817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:48.793817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:48.793817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:48.793817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:48.793817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:48.793817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:48.793817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:48.793817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:48.793817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:48.794937 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:48.794937 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:48.794937 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:48.794937 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:48.794937 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:48.794937 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:48.794937 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:48.794937 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:48.794937 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:48.794937 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:48.794937 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:48.794937 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:48.794937 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:48.794937 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:48.794937 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:48.794937 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:48.796098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:48.796098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:48.796098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:48.796098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:48.796098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:48.796098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:48.796098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:48.796098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:48.796098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:48.796098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:48.796098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:26:48.796098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:48.796098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 369/724] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 22 20:26:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:48.804147 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9f120-8b7c-4c53-9a9a-1b8f6a5fa07b None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:48.891886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75df09-301d-4f1b-8a9a-41a2548dfdb0 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:48.966414 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9f120-8b7c-4c53-9a9a-1b8f6a5fa07b None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:48.993905 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba4b2a7-d724-4971-adaa-cdb944db2eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:48.994521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4b2a7-d724-4971-adaa-cdb944db2eab None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:48.994800 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4b2a7-d724-4971-adaa-cdb944db2eab None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:48.995004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:48.995110 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4b2a7-d724-4971-adaa-cdb944db2eab None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:48.995696 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba4b2a7-d724-4971-adaa-cdb944db2eab None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:48.997100 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba4b2a7-d724-4971-adaa-cdb944db2eab None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:49.004904 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead21f48-5c20-4f84-8397-7ef3d5c1d51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:49.010672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead21f48-5c20-4f84-8397-7ef3d5c1d51f None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:49.010672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead21f48-5c20-4f84-8397-7ef3d5c1d51f None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:49.010672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead21f48-5c20-4f84-8397-7ef3d5c1d51f None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:49.010672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead21f48-5c20-4f84-8397-7ef3d5c1d51f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:49.010672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead21f48-5c20-4f84-8397-7ef3d5c1d51f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:49.010672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead21f48-5c20-4f84-8397-7ef3d5c1d51f None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:49.019673 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 370/725] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:26:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:26:49.025273 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead21f48-5c20-4f84-8397-7ef3d5c1d51f None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:49.128935 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead21f48-5c20-4f84-8397-7ef3d5c1d51f None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:49.143920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 356/726] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Aug 22 20:26:48 2022] POST /identity/v3/services => generated 251 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:26:49.187266 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1b978-f91d-40e0-b8d9-bacdc7c526da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:49.187908 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1b978-f91d-40e0-b8d9-bacdc7c526da None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:49.188191 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1b978-f91d-40e0-b8d9-bacdc7c526da None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:49.188459 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1b978-f91d-40e0-b8d9-bacdc7c526da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:49.201630 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1b978-f91d-40e0-b8d9-bacdc7c526da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:49.203372 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1b978-f91d-40e0-b8d9-bacdc7c526da None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:49.222828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-2ef1b978-f91d-40e0-b8d9-bacdc7c526da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:49.222828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:49.222828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:49.222828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:49.222828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:49.222828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:49.222828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:49.222828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:49.222828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:49.222828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:49.222828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:49.222828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:49.222828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:49.222828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:49.222828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:49.222828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:49.223863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:49.223863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:49.223863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:49.223863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:49.223863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:49.223863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:49.223863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:49.223863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:49.223863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:49.223863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:49.223863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:49.223863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:49.223863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:49.223863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:49.223863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:49.223863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:49.223863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:49.225429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:49.225429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:49.225429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:49.225429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 371/727] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:26:49.233830 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba4b2a7-d724-4971-adaa-cdb944db2eab None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:49.376809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:49.388113 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba4b2a7-d724-4971-adaa-cdb944db2eab None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:49.426329 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bdee3d-2e58-4dc0-9804-3a6cc2eec08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:49.430541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bdee3d-2e58-4dc0-9804-3a6cc2eec08b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:49.430541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bdee3d-2e58-4dc0-9804-3a6cc2eec08b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:49.430541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bdee3d-2e58-4dc0-9804-3a6cc2eec08b None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:49.430541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bdee3d-2e58-4dc0-9804-3a6cc2eec08b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:49.430541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bdee3d-2e58-4dc0-9804-3a6cc2eec08b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:49.430541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bdee3d-2e58-4dc0-9804-3a6cc2eec08b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:49.446942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 357/728] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:49.453376 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1b978-f91d-40e0-b8d9-bacdc7c526da None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:49.609638 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:49.678655 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1b978-f91d-40e0-b8d9-bacdc7c526da None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:49.714386 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbd155-738d-4bcb-9970-d71ca845378a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:49.715050 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbd155-738d-4bcb-9970-d71ca845378a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:49.715310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbd155-738d-4bcb-9970-d71ca845378a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:49.715544 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbd155-738d-4bcb-9970-d71ca845378a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:49.723727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cbd155-738d-4bcb-9970-d71ca845378a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:49.725218 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cbd155-738d-4bcb-9970-d71ca845378a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:49.736752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-c4cbd155-738d-4bcb-9970-d71ca845378a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 20:26:49.736752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:49.736752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:49.736752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:49.736752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:49.736752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:49.736752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:49.736752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:49.736752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:49.736752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:49.736752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:49.736752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:49.736752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:26:49.736752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:26:49.736752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:26:49.736752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:26:49.738359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:49.738359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:49.738359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:26:49.738359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:49.738359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:26:49.738359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:49.738359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:49.738359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:49.738359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:49.738359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:49.738359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:49.738359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:49.738359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:49.738359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:49.738359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:49.738359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:49.738359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:49.738359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:49.739893 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:49.739893 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:49.739893 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:26:49.739893 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:26:49.739893 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:26:49.739893 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:26:49.739893 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:26:49.739893 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:26:49.739893 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 20:26:49.739893 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:49.739893 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 372/729] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 22 20:26:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:49.744325 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bdee3d-2e58-4dc0-9804-3a6cc2eec08b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:49.843881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ff68c-75ad-44a1-ae37-b70f905d650a None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:49.844206 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ff68c-75ad-44a1-ae37-b70f905d650a None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:49.844426 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ff68c-75ad-44a1-ae37-b70f905d650a None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:49.846068 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 373/730] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:49.853935 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a19a8-ff0b-4762-aed0-c0ad682250c3 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:49.854497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a19a8-ff0b-4762-aed0-c0ad682250c3 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:49.854894 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a19a8-ff0b-4762-aed0-c0ad682250c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:49.889603 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-de1a19a8-ff0b-4762-aed0-c0ad682250c3 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:49.890242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bdee3d-2e58-4dc0-9804-3a6cc2eec08b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:49.890825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-de1a19a8-ff0b-4762-aed0-c0ad682250c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:49.935561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a3b5d-7aa2-4c7d-80ef-a0df5fe15402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:49.936450 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a3b5d-7aa2-4c7d-80ef-a0df5fe15402 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:49.936904 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a3b5d-7aa2-4c7d-80ef-a0df5fe15402 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:49.937342 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a3b5d-7aa2-4c7d-80ef-a0df5fe15402 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:49.938535 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a3b5d-7aa2-4c7d-80ef-a0df5fe15402 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:49.939279 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a3b5d-7aa2-4c7d-80ef-a0df5fe15402 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:49.941465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a3b5d-7aa2-4c7d-80ef-a0df5fe15402 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:49.963563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 358/731] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Aug 22 20:26:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:49.969798 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a3b5d-7aa2-4c7d-80ef-a0df5fe15402 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:49.982396 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:50.062287 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 374/732] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:49 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:50.075277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7b15a-59f2-436c-a54d-e679a4b410e2 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:50.075575 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7b15a-59f2-436c-a54d-e679a4b410e2 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:50.075835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7b15a-59f2-436c-a54d-e679a4b410e2 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:50.077649 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 375/733] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:26:50.080101 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a3b5d-7aa2-4c7d-80ef-a0df5fe15402 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:50.085501 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c08bf3-d136-4107-9e28-937d0b559a8c None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:50.086038 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c08bf3-d136-4107-9e28-937d0b559a8c None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:50.086513 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c08bf3-d136-4107-9e28-937d0b559a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:50.105421 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-51c08bf3-d136-4107-9e28-937d0b559a8c None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:50.106941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-51c08bf3-d136-4107-9e28-937d0b559a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:50.131245 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:50.162229 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc7405-9ce1-4e15-92a7-2fbc5367cf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:50.163555 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc7405-9ce1-4e15-92a7-2fbc5367cf70 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:50.164036 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc7405-9ce1-4e15-92a7-2fbc5367cf70 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:50.164563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc7405-9ce1-4e15-92a7-2fbc5367cf70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:50.213588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 376/734] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:50 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 20:26:50.300725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc7405-9ce1-4e15-92a7-2fbc5367cf70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:50.302191 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc7405-9ce1-4e15-92a7-2fbc5367cf70 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:50.317326 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:50.368337 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c08bf3-d136-4107-9e28-937d0b559a8c None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:50.464570 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 359/735] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:26:49 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 20:26:50.465944 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40307c-4ee4-48d0-84b4-aece5e859332 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:50.466228 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40307c-4ee4-48d0-84b4-aece5e859332 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:50.466493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40307c-4ee4-48d0-84b4-aece5e859332 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:50.468001 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 360/736] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:50.473682 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40307c-4ee4-48d0-84b4-aece5e859332 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:50.520571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c08bf3-d136-4107-9e28-937d0b559a8c None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:50.556926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeda86a-fd6e-497a-aeec-bb9df2268429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:50.557553 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeda86a-fd6e-497a-aeec-bb9df2268429 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:50.557826 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeda86a-fd6e-497a-aeec-bb9df2268429 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:50.558090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeda86a-fd6e-497a-aeec-bb9df2268429 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:50.568553 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeda86a-fd6e-497a-aeec-bb9df2268429 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:50.573254 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-7aeda86a-fd6e-497a-aeec-bb9df2268429 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:26:50.573254 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:50.573254 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:50.573254 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:50.573254 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:50.573254 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:50.573254 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:50.573254 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:50.573254 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:50.573254 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:50.573254 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:50.573254 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:50.573254 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:50.573254 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:50.573254 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:50.573254 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:50.574152 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:50.574152 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:50.574152 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:50.574152 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:50.574152 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:50.574152 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:50.574152 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:50.574152 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:50.574152 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:50.574152 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:50.574152 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:50.574152 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:50.574152 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:50.574152 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:50.574152 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:50.574152 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:50.574974 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:50.574974 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:50.574974 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:50.574974 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:50.574974 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:50.574974 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:50.574974 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:50.574974 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:50.574974 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:50.574974 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:50.574974 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:26:50.574974 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:50.574974 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 377/737] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 22 20:26:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:26:50.575653 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1a6c5-cfe8-47c0-85ea-68ac1e4a101d None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:50.575719 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1a6c5-cfe8-47c0-85ea-68ac1e4a101d None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:50.576852 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e1a6c5-cfe8-47c0-85ea-68ac1e4a101d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:50.594990 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-06e1a6c5-cfe8-47c0-85ea-68ac1e4a101d None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:50.596236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-06e1a6c5-cfe8-47c0-85ea-68ac1e4a101d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:50.608928 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:50.612553 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40307c-4ee4-48d0-84b4-aece5e859332 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:50.665993 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 378/738] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:50 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 20:26:50.667084 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1a6c5-cfe8-47c0-85ea-68ac1e4a101d None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:50.710505 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:50.746083 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cebc10c-a08d-4c8e-8ab8-820bac877974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:50.747078 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebc10c-a08d-4c8e-8ab8-820bac877974 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:50.747574 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebc10c-a08d-4c8e-8ab8-820bac877974 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:50.748200 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebc10c-a08d-4c8e-8ab8-820bac877974 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:50.762406 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cebc10c-a08d-4c8e-8ab8-820bac877974 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:50.764511 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cebc10c-a08d-4c8e-8ab8-820bac877974 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:50.784685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-8cebc10c-a08d-4c8e-8ab8-820bac877974 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:50.784685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:50.784685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:50.784685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:50.784685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:50.784685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:50.784685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:50.784685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:50.784685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:50.784685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:50.784685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:50.784685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:50.784685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:50.784685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:50.784685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:50.784685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:50.785731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:50.785731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:50.785731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:50.785731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:50.785731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:50.785731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:50.785731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:50.785731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:50.785731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:50.785731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:50.785731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:50.785731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:50.785731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:50.785731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:50.785731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:50.785731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:50.785731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:50.786623 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:50.786623 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:50.786623 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:50.789937 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 361/739] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:50.791005 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cebc10c-a08d-4c8e-8ab8-820bac877974 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:50.838907 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e1a6c5-cfe8-47c0-85ea-68ac1e4a101d None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:50.884442 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655da53-1ee7-4f46-9954-3134b4cd91c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:50.885707 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655da53-1ee7-4f46-9954-3134b4cd91c6 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:50.886189 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655da53-1ee7-4f46-9954-3134b4cd91c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:50.886898 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655da53-1ee7-4f46-9954-3134b4cd91c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:50.900832 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f655da53-1ee7-4f46-9954-3134b4cd91c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:50.906985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-f655da53-1ee7-4f46-9954-3134b4cd91c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:26:50.906985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:50.906985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:50.906985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:50.906985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:50.906985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:50.906985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:50.906985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:50.906985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:50.906985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:50.906985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:50.906985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:50.906985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:50.906985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:50.906985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:50.906985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:50.907907 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:50.907907 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:50.907907 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:50.907907 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:50.907907 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:50.907907 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:50.907907 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:50.907907 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:50.907907 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:50.907907 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:50.907907 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:50.907907 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:50.907907 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:50.907907 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:50.907907 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:50.907907 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:50.909352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:50.909352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:50.909352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:50.909352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:50.909352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:50.909352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:50.909352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:50.909352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:50.909352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:50.909352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:50.909352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:26:50.909352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:50.911657 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 379/740] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 22 20:26:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:50.912268 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655da53-1ee7-4f46-9954-3134b4cd91c6 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:50.924184 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:50.925231 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cebc10c-a08d-4c8e-8ab8-820bac877974 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:50.961556 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c89bbb-b859-497a-9b00-512a07aad469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:50.962162 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c89bbb-b859-497a-9b00-512a07aad469 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:50.962439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c89bbb-b859-497a-9b00-512a07aad469 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:50.962708 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c89bbb-b859-497a-9b00-512a07aad469 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:50.963360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c89bbb-b859-497a-9b00-512a07aad469 None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:50.963656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c89bbb-b859-497a-9b00-512a07aad469 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:50.965062 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c89bbb-b859-497a-9b00-512a07aad469 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:50.974550 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 362/741] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 22 20:26:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:50.975376 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c89bbb-b859-497a-9b00-512a07aad469 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:51.002902 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:51.033297 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655da53-1ee7-4f46-9954-3134b4cd91c6 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:51.069781 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d1c72-ecf8-465d-8d33-61e52fe86ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:51.070386 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d1c72-ecf8-465d-8d33-61e52fe86ee1 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:51.070664 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d1c72-ecf8-465d-8d33-61e52fe86ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:51.070934 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d1c72-ecf8-465d-8d33-61e52fe86ee1 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:51.071576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d1c72-ecf8-465d-8d33-61e52fe86ee1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:51.071877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d1c72-ecf8-465d-8d33-61e52fe86ee1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:51.073270 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d1c72-ecf8-465d-8d33-61e52fe86ee1 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:51.086222 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 380/742] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:51.088523 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c89bbb-b859-497a-9b00-512a07aad469 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:51.091197 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d1c72-ecf8-465d-8d33-61e52fe86ee1 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:51.125026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5e85e-da4a-4169-ae2a-a112e8433697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:51.125667 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5e85e-da4a-4169-ae2a-a112e8433697 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:51.125935 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5e85e-da4a-4169-ae2a-a112e8433697 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:51.126206 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5e85e-da4a-4169-ae2a-a112e8433697 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:51.126863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5e85e-da4a-4169-ae2a-a112e8433697 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:51.127164 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5e85e-da4a-4169-ae2a-a112e8433697 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:51.128571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5e85e-da4a-4169-ae2a-a112e8433697 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:51.137689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 363/743] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:26:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:51.138501 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5e85e-da4a-4169-ae2a-a112e8433697 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:51.165881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:51.202826 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d1c72-ecf8-465d-8d33-61e52fe86ee1 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:51.230454 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:51.240922 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6d9f3-c9a7-45bb-b9dd-efecddf2e032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:51.241546 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6d9f3-c9a7-45bb-b9dd-efecddf2e032 None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:51.241804 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6d9f3-c9a7-45bb-b9dd-efecddf2e032 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:51.242116 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6d9f3-c9a7-45bb-b9dd-efecddf2e032 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:51.242887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6d9f3-c9a7-45bb-b9dd-efecddf2e032 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:51.244251 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6d9f3-c9a7-45bb-b9dd-efecddf2e032 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:51.247009 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5e85e-da4a-4169-ae2a-a112e8433697 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:51.282858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd785ba-37d1-4fde-bb92-b64f0334af27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:51.283403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd785ba-37d1-4fde-bb92-b64f0334af27 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:51.283802 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd785ba-37d1-4fde-bb92-b64f0334af27 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:51.284695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd785ba-37d1-4fde-bb92-b64f0334af27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:51.295462 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd785ba-37d1-4fde-bb92-b64f0334af27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:51.299584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd785ba-37d1-4fde-bb92-b64f0334af27 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:51.311309 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-edd785ba-37d1-4fde-bb92-b64f0334af27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:51.311309 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:51.311309 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:51.311309 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:51.311309 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:51.311309 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:51.311309 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:51.311309 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:51.311309 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:51.311309 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:51.311309 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:51.311309 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:51.311309 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:51.311309 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:51.311309 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:51.311309 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:51.317274 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:51.317274 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:51.317274 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:51.317274 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:51.317274 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:51.317274 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:51.317274 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:51.317274 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:51.317274 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:51.317274 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:51.317274 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:51.317274 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:51.317274 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:51.317274 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:51.317274 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:51.317274 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:51.317274 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:51.318348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:51.318348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:51.318348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:51.318348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 364/744] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:51.318348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd785ba-37d1-4fde-bb92-b64f0334af27 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:51.323786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 381/745] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Aug 22 20:26:51 2022] POST /identity/v3/services => generated 240 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:26:51.324614 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6d9f3-c9a7-45bb-b9dd-efecddf2e032 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:51.442224 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd785ba-37d1-4fde-bb92-b64f0334af27 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:51.472387 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6d9f3-c9a7-45bb-b9dd-efecddf2e032 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:51.481173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26f94f-af99-48d5-96d1-185c317480b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:51.481814 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26f94f-af99-48d5-96d1-185c317480b1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:51.482081 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26f94f-af99-48d5-96d1-185c317480b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:51.482347 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26f94f-af99-48d5-96d1-185c317480b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:51.485326 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:51.492811 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c26f94f-af99-48d5-96d1-185c317480b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:51.494439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c26f94f-af99-48d5-96d1-185c317480b1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:51.504535 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:51.506842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-8c26f94f-af99-48d5-96d1-185c317480b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:51.506842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:51.506842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:51.506842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:51.506842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:51.506842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:51.506842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:51.506842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:51.506842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:51.506842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:51.506842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:51.506842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:51.506842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:26:51.506842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:26:51.506842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:26:51.507723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:26:51.507723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:51.507723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:51.507723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:51.507723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:51.507723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:51.507723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:51.507723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:51.507723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:51.507723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:51.507723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:51.507723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:51.507723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:51.507723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:51.507723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:51.507723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:51.507723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:51.508602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:26:51.508602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:26:51.508602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:26:51.508602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:26:51.508602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:26:51.508602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:26:51.508602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:51.508602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:51.508602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 365/746] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:26:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:51.509130 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26f94f-af99-48d5-96d1-185c317480b1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:51.517731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7ee80-d742-4909-b728-dc680dbb989b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:51.519378 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7ee80-d742-4909-b728-dc680dbb989b None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:51.519838 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7ee80-d742-4909-b728-dc680dbb989b None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:51.520283 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7ee80-d742-4909-b728-dc680dbb989b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:51.533191 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b7ee80-d742-4909-b728-dc680dbb989b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:51.535263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b7ee80-d742-4909-b728-dc680dbb989b None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:51.553694 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-49b7ee80-d742-4909-b728-dc680dbb989b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:51.553694 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:51.553694 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:51.553694 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:51.553694 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:51.553694 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:51.553694 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:51.553694 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:51.553694 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:51.553694 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:51.553694 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:51.553694 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:51.553694 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:51.553694 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:51.553694 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:51.553694 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:51.554873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:51.554873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:51.554873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:51.554873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:51.554873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:51.554873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:51.554873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:51.554873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:51.554873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:51.554873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:51.554873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:51.554873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:51.554873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:51.554873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:51.554873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:51.554873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:51.554873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:51.555925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:51.555925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:51.555925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:51.557516 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 382/747] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:51.558362 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7ee80-d742-4909-b728-dc680dbb989b None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:51.627231 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26f94f-af99-48d5-96d1-185c317480b1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:51.664902 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31171825-e6f6-448d-98d9-dc54c76e6d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:51.665505 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31171825-e6f6-448d-98d9-dc54c76e6d8e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:51.665788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31171825-e6f6-448d-98d9-dc54c76e6d8e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:51.666067 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31171825-e6f6-448d-98d9-dc54c76e6d8e None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:51.666707 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31171825-e6f6-448d-98d9-dc54c76e6d8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:51.667009 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31171825-e6f6-448d-98d9-dc54c76e6d8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:51.668387 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31171825-e6f6-448d-98d9-dc54c76e6d8e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:51.676585 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7ee80-d742-4909-b728-dc680dbb989b None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:51.680702 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 366/748] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:51.681183 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31171825-e6f6-448d-98d9-dc54c76e6d8e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:51.719656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69655f-74ec-406e-924b-345d92a27f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:51.720383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69655f-74ec-406e-924b-345d92a27f81 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:51.720672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69655f-74ec-406e-924b-345d92a27f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:51.720947 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69655f-74ec-406e-924b-345d92a27f81 None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:51.721668 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69655f-74ec-406e-924b-345d92a27f81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:51.721972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69655f-74ec-406e-924b-345d92a27f81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:51.723372 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69655f-74ec-406e-924b-345d92a27f81 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:51.741721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 383/749] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 22 20:26:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:51.743009 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:51.743897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fa1ef-0a4c-4c94-8ead-92e6e95513d8 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:51.744099 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fa1ef-0a4c-4c94-8ead-92e6e95513d8 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:51.744336 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fa1ef-0a4c-4c94-8ead-92e6e95513d8 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:51.749757 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 384/750] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:51.749757 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fa1ef-0a4c-4c94-8ead-92e6e95513d8 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:51.788782 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:51.795951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31171825-e6f6-448d-98d9-dc54c76e6d8e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:51.834722 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cb01a-7ca0-402e-9a5b-6df23b6bd9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:51.836118 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cb01a-7ca0-402e-9a5b-6df23b6bd9a1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:51.836409 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cb01a-7ca0-402e-9a5b-6df23b6bd9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:51.836678 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169cb01a-7ca0-402e-9a5b-6df23b6bd9a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:51.837414 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169cb01a-7ca0-402e-9a5b-6df23b6bd9a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:51.837716 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169cb01a-7ca0-402e-9a5b-6df23b6bd9a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:51.839103 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169cb01a-7ca0-402e-9a5b-6df23b6bd9a1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:51.856704 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 367/751] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:51.856704 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cb01a-7ca0-402e-9a5b-6df23b6bd9a1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:51.873074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fa1ef-0a4c-4c94-8ead-92e6e95513d8 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:51.908743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2138d20a-4561-4930-b03c-dc60c83bd994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:51.909957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138d20a-4561-4930-b03c-dc60c83bd994 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:51.910244 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138d20a-4561-4930-b03c-dc60c83bd994 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:51.910513 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2138d20a-4561-4930-b03c-dc60c83bd994 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:51.918004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138d20a-4561-4930-b03c-dc60c83bd994 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:51.919439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2138d20a-4561-4930-b03c-dc60c83bd994 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:51.935549 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-2138d20a-4561-4930-b03c-dc60c83bd994 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 20:26:51.935549 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:51.935549 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:51.935549 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:51.935549 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:51.935549 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:51.935549 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:51.935549 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:51.935549 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:51.935549 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:51.935549 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:51.935549 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:51.935549 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:26:51.935549 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:26:51.935549 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:26:51.935549 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:26:51.936524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:51.936524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:51.936524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:26:51.936524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:51.936524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:26:51.936524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:51.936524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:51.936524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:51.936524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:51.936524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:51.936524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:51.936524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:51.936524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:51.936524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:51.936524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:51.936524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:51.936524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:51.936524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:51.943139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:51.943139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:51.943139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:26:51.943139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:26:51.943139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:26:51.943139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:26:51.943139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:26:51.943139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:26:51.943139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 20:26:51.943139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:51.943139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 385/752] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Aug 22 20:26:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:51.943139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f910b-0825-4e8c-9f0f-9f40293878d1 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:51.943139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f910b-0825-4e8c-9f0f-9f40293878d1 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:51.944017 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f910b-0825-4e8c-9f0f-9f40293878d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:51.962192 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-8a1f910b-0825-4e8c-9f0f-9f40293878d1 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:51.963423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-8a1f910b-0825-4e8c-9f0f-9f40293878d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:51.972869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169cb01a-7ca0-402e-9a5b-6df23b6bd9a1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:51.991078 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:52.010556 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b31c08-a62c-4867-8bea-66633e5be88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:52.011168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b31c08-a62c-4867-8bea-66633e5be88b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:52.011445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b31c08-a62c-4867-8bea-66633e5be88b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:52.011732 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b31c08-a62c-4867-8bea-66633e5be88b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:52.012480 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b31c08-a62c-4867-8bea-66633e5be88b None admin] RBAC: Adding query filter params (role.id=e3faa0474c054da6bb4d8910a4e40bff, scope.project.id=783c362712d34405ab827e3f00a67995, user.id=907607fd209b416ba9b68512772c1d17) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:52.012805 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b31c08-a62c-4867-8bea-66633e5be88b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:52.014245 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b31c08-a62c-4867-8bea-66633e5be88b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:52.028705 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 368/753] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:26:51 2022] GET /identity/v3/role_assignments?user.id=907607fd209b416ba9b68512772c1d17&scope.project.id=783c362712d34405ab827e3f00a67995&role.id=e3faa0474c054da6bb4d8910a4e40bff => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:52.028705 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b31c08-a62c-4867-8bea-66633e5be88b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:52.046818 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 386/754] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:26:52.047777 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f910b-0825-4e8c-9f0f-9f40293878d1 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:52.121136 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:52.240627 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f910b-0825-4e8c-9f0f-9f40293878d1 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:52.242767 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b31c08-a62c-4867-8bea-66633e5be88b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:52.298652 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48259f-31e4-4906-8832-2fa8f6f12db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:52.299191 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48259f-31e4-4906-8832-2fa8f6f12db0 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:52.299515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48259f-31e4-4906-8832-2fa8f6f12db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:52.299974 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48259f-31e4-4906-8832-2fa8f6f12db0 None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:52.300959 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48259f-31e4-4906-8832-2fa8f6f12db0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:52.301264 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48259f-31e4-4906-8832-2fa8f6f12db0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:52.302697 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48259f-31e4-4906-8832-2fa8f6f12db0 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:52.312310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1caae5-27b6-4e2b-ab52-e662f5a12cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:52.312956 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1caae5-27b6-4e2b-ab52-e662f5a12cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:52.313237 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1caae5-27b6-4e2b-ab52-e662f5a12cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:52.313510 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1caae5-27b6-4e2b-ab52-e662f5a12cc9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:52.322748 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1caae5-27b6-4e2b-ab52-e662f5a12cc9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:52.324012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1caae5-27b6-4e2b-ab52-e662f5a12cc9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:52.332890 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 387/755] 10.222.0.62 () {56 vars in 1149 bytes} [Mon Aug 22 20:26:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:52.336726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-8d1caae5-27b6-4e2b-ab52-e662f5a12cc9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:26:52.336726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:52.336726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:52.336726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:52.336726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:52.336726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:52.336726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:52.336726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:52.336726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:52.336726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:52.336726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:52.336726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:52.336726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:26:52.336726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:26:52.336726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:26:52.336726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:26:52.337627 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:52.337627 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:52.337627 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:26:52.337627 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:52.337627 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:26:52.337627 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:52.337627 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:52.337627 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:52.337627 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:52.337627 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:52.337627 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:52.337627 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:52.337627 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:52.337627 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:52.337627 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:52.337627 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:52.337627 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:52.337627 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:52.338571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:52.338571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:52.338571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:26:52.338571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:26:52.338571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:26:52.338571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:26:52.338571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:26:52.338571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:26:52.338571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:26:52.338571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:52.338571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 369/756] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Aug 22 20:26:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:52.343861 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48259f-31e4-4906-8832-2fa8f6f12db0 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:52.345064 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1caae5-27b6-4e2b-ab52-e662f5a12cc9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:52.405997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:52.464941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:52.479419 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1caae5-27b6-4e2b-ab52-e662f5a12cc9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:52.490721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48259f-31e4-4906-8832-2fa8f6f12db0 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:52.531368 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea3970-03eb-4b62-899b-cf9968235ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:52.531985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea3970-03eb-4b62-899b-cf9968235ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:52.532266 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea3970-03eb-4b62-899b-cf9968235ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:52.532546 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea3970-03eb-4b62-899b-cf9968235ae9 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:52.534051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea3970-03eb-4b62-899b-cf9968235ae9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:52.536696 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea3970-03eb-4b62-899b-cf9968235ae9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:52.538523 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea3970-03eb-4b62-899b-cf9968235ae9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:52.542331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2a888-882e-4f3f-8d27-b58638b50b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:52.543194 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2a888-882e-4f3f-8d27-b58638b50b2f None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:52.543680 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2a888-882e-4f3f-8d27-b58638b50b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:52.544154 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2a888-882e-4f3f-8d27-b58638b50b2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:52.559233 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 370/757] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Aug 22 20:26:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:52.559734 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea3970-03eb-4b62-899b-cf9968235ae9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:52.621796 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2a888-882e-4f3f-8d27-b58638b50b2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:52.623702 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2a888-882e-4f3f-8d27-b58638b50b2f None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:52.667989 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:52.672334 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea3970-03eb-4b62-899b-cf9968235ae9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:52.709661 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01dec2-a206-4cdf-be98-938330990ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:52.710418 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01dec2-a206-4cdf-be98-938330990ddb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:52.710706 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01dec2-a206-4cdf-be98-938330990ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:52.710981 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01dec2-a206-4cdf-be98-938330990ddb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:52.711651 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c01dec2-a206-4cdf-be98-938330990ddb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:52.712997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c01dec2-a206-4cdf-be98-938330990ddb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:52.713225 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:52.724382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-5c01dec2-a206-4cdf-be98-938330990ddb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 20:26:52.724382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:52.724382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:26:52.724382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:26:52.724382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:26:52.724382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:26:52.724382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:26:52.724382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:26:52.724382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 20:26:52.724382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:52.724382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:26:52.724382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:52.724382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:52.724382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:52.724382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:52.724382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:52.724382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:52.727015 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:52.727015 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:52.727015 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:52.727015 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:52.727015 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:52.727015 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:52.727015 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:26:52.727015 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:26:52.727015 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:26:52.727015 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:26:52.727015 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:52.727015 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:52.727015 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:52.727015 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:52.727015 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:52.727015 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:52.727828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:52.727828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:52.727828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:52.727828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:52.727828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:52.727828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:52.727828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:52.727828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:52.727828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:52.727828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:52.727828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:26:52.727828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:26:52.727828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 20:26:52.727828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:52.727828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 371/758] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Aug 22 20:26:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:52.728626 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01dec2-a206-4cdf-be98-938330990ddb None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:52.741558 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 388/759] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:26:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 20:26:52.743066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2a888-882e-4f3f-8d27-b58638b50b2f None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:52.876687 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01dec2-a206-4cdf-be98-938330990ddb None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:52.879168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2a888-882e-4f3f-8d27-b58638b50b2f None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:52.922091 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161273f-6c01-4fd7-87d4-7b3daf2d23cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:52.922881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba68360-67dc-442a-9b07-36990e84d797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:52.923016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161273f-6c01-4fd7-87d4-7b3daf2d23cd None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:52.923363 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161273f-6c01-4fd7-87d4-7b3daf2d23cd None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:52.923735 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7161273f-6c01-4fd7-87d4-7b3daf2d23cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:52.924097 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba68360-67dc-442a-9b07-36990e84d797 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:52.925076 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba68360-67dc-442a-9b07-36990e84d797 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:52.925508 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba68360-67dc-442a-9b07-36990e84d797 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:52.926354 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba68360-67dc-442a-9b07-36990e84d797 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:52.926975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba68360-67dc-442a-9b07-36990e84d797 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:52.928913 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba68360-67dc-442a-9b07-36990e84d797 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:52.934576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 389/760] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Aug 22 20:26:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:52.935613 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba68360-67dc-442a-9b07-36990e84d797 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:52.939856 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161273f-6c01-4fd7-87d4-7b3daf2d23cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:52.942226 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7161273f-6c01-4fd7-87d4-7b3daf2d23cd None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:52.961382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-7161273f-6c01-4fd7-87d4-7b3daf2d23cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:52.961382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:52.961382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:52.961382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:52.961382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:52.961382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:52.961382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:52.961382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:52.961382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:52.961382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:52.961382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:52.961382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:52.961382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:52.961382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:52.961382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:52.961382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:52.962512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:52.962512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:52.962512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:52.962512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:52.962512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:52.962512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:52.962512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:52.962512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:52.962512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:52.962512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:52.962512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:52.962512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:52.962512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:52.962512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:52.962512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:52.962512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:52.962512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:52.963420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:52.963420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:52.963420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:52.970028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 372/761] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:52.971637 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161273f-6c01-4fd7-87d4-7b3daf2d23cd None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:52.989180 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:52.996688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:53.054699 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba68360-67dc-442a-9b07-36990e84d797 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:53.079401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7161273f-6c01-4fd7-87d4-7b3daf2d23cd None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:53.093028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7dc5a9-b6cb-4dd1-96a7-f221108d32fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:53.094010 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7dc5a9-b6cb-4dd1-96a7-f221108d32fc None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:53.094474 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7dc5a9-b6cb-4dd1-96a7-f221108d32fc None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:53.094952 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7dc5a9-b6cb-4dd1-96a7-f221108d32fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:53.107420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7dc5a9-b6cb-4dd1-96a7-f221108d32fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:53.109423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7dc5a9-b6cb-4dd1-96a7-f221108d32fc None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:53.117600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7d17f-ed9c-4dea-8989-2999c4c34539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:53.118409 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7d17f-ed9c-4dea-8989-2999c4c34539 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:53.118744 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7d17f-ed9c-4dea-8989-2999c4c34539 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:53.119141 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7d17f-ed9c-4dea-8989-2999c4c34539 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:53.119900 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7d17f-ed9c-4dea-8989-2999c4c34539 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:53.120306 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7d17f-ed9c-4dea-8989-2999c4c34539 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:53.121937 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7d17f-ed9c-4dea-8989-2999c4c34539 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:53.132617 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 373/762] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Aug 22 20:26:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:53.132617 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7d17f-ed9c-4dea-8989-2999c4c34539 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:53.133122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-cf7dc5a9-b6cb-4dd1-96a7-f221108d32fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:53.133122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:53.133122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:53.133122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:53.133122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:53.133122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:53.133122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:53.133122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:53.133122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:53.133122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:53.133122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:53.133122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:53.133122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:53.133122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:53.133122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:53.133122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:53.134139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:53.134139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:53.134139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:53.134139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:53.134139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:53.134139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:53.134139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:53.134139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:53.134139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:53.134139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:53.134139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:53.134139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:53.134139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:53.134139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:53.134139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:53.134139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:53.134139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:53.135017 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:53.135017 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:53.135017 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:53.137017 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 390/763] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:53.137997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7dc5a9-b6cb-4dd1-96a7-f221108d32fc None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:53.218894 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:53.241474 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7d17f-ed9c-4dea-8989-2999c4c34539 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:53.256522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:53.261506 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7dc5a9-b6cb-4dd1-96a7-f221108d32fc None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:53.277890 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d62a58-b1e0-4f92-8fa5-999652372d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:53.278593 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d62a58-b1e0-4f92-8fa5-999652372d1c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:53.278951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d62a58-b1e0-4f92-8fa5-999652372d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:53.279298 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d62a58-b1e0-4f92-8fa5-999652372d1c None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:53.280012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d62a58-b1e0-4f92-8fa5-999652372d1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:53.280385 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d62a58-b1e0-4f92-8fa5-999652372d1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:53.281906 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d62a58-b1e0-4f92-8fa5-999652372d1c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:53.300288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 374/764] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:53.301327 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d62a58-b1e0-4f92-8fa5-999652372d1c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:53.303472 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed5527-00e1-443f-b356-17c677ee0b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:53.304395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed5527-00e1-443f-b356-17c677ee0b77 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:53.304899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed5527-00e1-443f-b356-17c677ee0b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:53.305461 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed5527-00e1-443f-b356-17c677ee0b77 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:53.306374 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed5527-00e1-443f-b356-17c677ee0b77 None admin] RBAC: Adding query filter params (interface=public, service_id=eba7dca1771c4c8c81082cdd9fe9b549, region_id=RegionOne) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:53.306886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed5527-00e1-443f-b356-17c677ee0b77 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:53.308484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed5527-00e1-443f-b356-17c677ee0b77 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:53.322034 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 391/765] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Aug 22 20:26:53 2022] GET /identity/v3/endpoints?service_id=eba7dca1771c4c8c81082cdd9fe9b549&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:53.323222 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed5527-00e1-443f-b356-17c677ee0b77 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:53.412217 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d62a58-b1e0-4f92-8fa5-999652372d1c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:53.438156 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed5527-00e1-443f-b356-17c677ee0b77 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:53.449541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bd81a-48df-4737-b2d3-12215f6ced28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:53.450151 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bd81a-48df-4737-b2d3-12215f6ced28 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:53.450436 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bd81a-48df-4737-b2d3-12215f6ced28 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:53.450713 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bd81a-48df-4737-b2d3-12215f6ced28 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:53.451609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bd81a-48df-4737-b2d3-12215f6ced28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:53.451911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bd81a-48df-4737-b2d3-12215f6ced28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:53.453332 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bd81a-48df-4737-b2d3-12215f6ced28 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:53.461254 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:53.466577 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 375/766] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:53.467388 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bd81a-48df-4737-b2d3-12215f6ced28 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:53.481064 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a620af7-7c56-45c9-889e-de23a9eaab55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:53.481701 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a620af7-7c56-45c9-889e-de23a9eaab55 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:53.481979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a620af7-7c56-45c9-889e-de23a9eaab55 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:53.482256 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a620af7-7c56-45c9-889e-de23a9eaab55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:53.490730 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a620af7-7c56-45c9-889e-de23a9eaab55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:53.492178 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a620af7-7c56-45c9-889e-de23a9eaab55 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:53.506020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-7a620af7-7c56-45c9-889e-de23a9eaab55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:53.506020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:53.506020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:53.506020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:53.506020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:53.506020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:53.506020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:53.506020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:53.506020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:53.506020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:53.506020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:53.506020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:53.506020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:26:53.506020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:26:53.506020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:26:53.507016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:26:53.507016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:53.507016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:53.507016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:53.507016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:53.507016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:53.507016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:53.507016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:53.507016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:53.507016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:53.507016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:53.507016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:53.507016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:53.507016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:53.507016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:53.507016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:53.507016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:53.507991 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:26:53.507991 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:26:53.507991 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:26:53.507991 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:26:53.507991 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:26:53.507991 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:26:53.507991 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:53.507991 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:53.507991 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 392/767] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:26:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:53.508471 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098fbcc-5e7a-4bc4-99d6-f77c977a0926 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:53.508541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098fbcc-5e7a-4bc4-99d6-f77c977a0926 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:53.508962 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098fbcc-5e7a-4bc4-99d6-f77c977a0926 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:53.510158 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 393/768] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:53.510703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098fbcc-5e7a-4bc4-99d6-f77c977a0926 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:53.538796 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:53.601497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bd81a-48df-4737-b2d3-12215f6ced28 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:53.634165 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098fbcc-5e7a-4bc4-99d6-f77c977a0926 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:53.639435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027e7d7-902c-474a-8daa-4beda5c66ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:53.640050 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027e7d7-902c-474a-8daa-4beda5c66ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:53.640333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027e7d7-902c-474a-8daa-4beda5c66ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:53.640606 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3027e7d7-902c-474a-8daa-4beda5c66ab3 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:53.641245 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027e7d7-902c-474a-8daa-4beda5c66ab3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:53.642715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3027e7d7-902c-474a-8daa-4beda5c66ab3 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:53.660688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 376/769] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Aug 22 20:26:53 2022] GET /identity/v3/services => generated 772 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:53.660688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027e7d7-902c-474a-8daa-4beda5c66ab3 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:53.687043 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309bdedc-f974-4bfc-8f08-643240aad743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:53.688288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309bdedc-f974-4bfc-8f08-643240aad743 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:53.688641 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309bdedc-f974-4bfc-8f08-643240aad743 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:53.689203 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309bdedc-f974-4bfc-8f08-643240aad743 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:53.699707 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309bdedc-f974-4bfc-8f08-643240aad743 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:53.701762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309bdedc-f974-4bfc-8f08-643240aad743 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:53.717236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-309bdedc-f974-4bfc-8f08-643240aad743 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:53.717236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:53.717236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:53.717236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:53.717236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:53.717236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:53.717236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:53.717236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:53.717236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:53.717236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:53.717236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:53.717236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:53.717236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:26:53.717236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:26:53.717236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:26:53.718174 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:26:53.718174 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:53.718174 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:53.718174 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:53.718174 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:53.718174 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:53.718174 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:53.718174 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:53.718174 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:53.718174 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:53.718174 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:53.718174 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:53.718174 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:53.718174 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:53.718174 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:53.718174 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:53.718174 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:53.719056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:26:53.719056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:26:53.719056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:26:53.719056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:26:53.719056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:26:53.719056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:26:53.719056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:53.719056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:53.719482 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 394/770] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:26:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:53.720807 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c70324-1c01-4097-88da-b11c782c34b4 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:53.721641 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c70324-1c01-4097-88da-b11c782c34b4 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:53.721900 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c70324-1c01-4097-88da-b11c782c34b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:53.741069 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:53.746081 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-57c70324-1c01-4097-88da-b11c782c34b4 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:53.747483 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-57c70324-1c01-4097-88da-b11c782c34b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:53.786925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3027e7d7-902c-474a-8daa-4beda5c66ab3 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:53.838623 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b5d8e-8310-4d33-adf9-8b458d66addb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:53.839514 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b5d8e-8310-4d33-adf9-8b458d66addb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:53.839943 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b5d8e-8310-4d33-adf9-8b458d66addb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:53.840222 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b5d8e-8310-4d33-adf9-8b458d66addb None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:53.840981 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b5d8e-8310-4d33-adf9-8b458d66addb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:53.841286 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b5d8e-8310-4d33-adf9-8b458d66addb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:53.842719 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b5d8e-8310-4d33-adf9-8b458d66addb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:53.847787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 395/771] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:26:53.848694 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c70324-1c01-4097-88da-b11c782c34b4 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:53.858390 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 377/772] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 22 20:26:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:53.864264 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:53.866986 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b5d8e-8310-4d33-adf9-8b458d66addb None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:53.966114 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c70324-1c01-4097-88da-b11c782c34b4 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:53.998225 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b5d8e-8310-4d33-adf9-8b458d66addb None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:54.042231 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3cf235-e08c-47cc-b912-1fcd429cfc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:54.042850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cf235-e08c-47cc-b912-1fcd429cfc9b None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:54.043123 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cf235-e08c-47cc-b912-1fcd429cfc9b None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:54.043397 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cf235-e08c-47cc-b912-1fcd429cfc9b None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:54.044102 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3cf235-e08c-47cc-b912-1fcd429cfc9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:54.044406 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3cf235-e08c-47cc-b912-1fcd429cfc9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:54.044650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:54.045879 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3cf235-e08c-47cc-b912-1fcd429cfc9b None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:54.060648 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e7dc9-914f-471b-87a1-eabaf65f9185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:54.061615 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e7dc9-914f-471b-87a1-eabaf65f9185 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:54.061895 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e7dc9-914f-471b-87a1-eabaf65f9185 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:54.062169 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e7dc9-914f-471b-87a1-eabaf65f9185 None admin] PATH_INFO: `/v3/projects/783c362712d34405ab827e3f00a67995/users/9f1738f72b4848499cdf0ec6866c3c8f/roles/e3faa0474c054da6bb4d8910a4e40bff` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:54.064195 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e7dc9-914f-471b-87a1-eabaf65f9185 None admin] RBAC: Authorizing `identity:create_grant(project_id=783c362712d34405ab827e3f00a67995, user_id=9f1738f72b4848499cdf0ec6866c3c8f, role_id=e3faa0474c054da6bb4d8910a4e40bff)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:54.065936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e7dc9-914f-471b-87a1-eabaf65f9185 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:54.074311 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 396/773] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 22 20:26:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:54.075494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16ba88-1a9a-46a8-8d0c-6864ed3072b0 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:54.075722 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16ba88-1a9a-46a8-8d0c-6864ed3072b0 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:54.076273 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16ba88-1a9a-46a8-8d0c-6864ed3072b0 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:54.077595 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 397/774] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:54.085514 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16ba88-1a9a-46a8-8d0c-6864ed3072b0 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:54.151807 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 378/775] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 22 20:26:53 2022] PUT /identity/v3/projects/783c362712d34405ab827e3f00a67995/users/9f1738f72b4848499cdf0ec6866c3c8f/roles/e3faa0474c054da6bb4d8910a4e40bff => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:26:54.156070 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd0be1-a113-4874-aa4a-695a511a96db None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:54.156070 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd0be1-a113-4874-aa4a-695a511a96db None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:54.156070 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd0be1-a113-4874-aa4a-695a511a96db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:54.180109 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-e4fd0be1-a113-4874-aa4a-695a511a96db None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:54.181216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:54.182364 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e4fd0be1-a113-4874-aa4a-695a511a96db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:54.218783 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16ba88-1a9a-46a8-8d0c-6864ed3072b0 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:54.269427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a600cf-ab19-49e6-a434-15f4c4c47a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:54.270396 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a600cf-ab19-49e6-a434-15f4c4c47a63 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:54.270678 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a600cf-ab19-49e6-a434-15f4c4c47a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:54.270952 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a600cf-ab19-49e6-a434-15f4c4c47a63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:54.272056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a600cf-ab19-49e6-a434-15f4c4c47a63 None admin] RBAC: Adding query filter params (role.id=38bb7e6ed5854439aeaf5996eb6892f6, scope.project.id=783c362712d34405ab827e3f00a67995, user.id=51ed4c996cde4e88be26544c48200695) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:54.272860 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a600cf-ab19-49e6-a434-15f4c4c47a63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:54.274729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a600cf-ab19-49e6-a434-15f4c4c47a63 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:54.277628 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 379/776] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:26:54.278627 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd0be1-a113-4874-aa4a-695a511a96db None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:54.293222 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 398/777] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:26:54 2022] GET /identity/v3/role_assignments?user.id=51ed4c996cde4e88be26544c48200695&scope.project.id=783c362712d34405ab827e3f00a67995&role.id=38bb7e6ed5854439aeaf5996eb6892f6 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:54.406442 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd0be1-a113-4874-aa4a-695a511a96db None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:54.422109 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:54.445230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063a5f8-ec31-4a4d-a097-9ed6703d9867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:54.445961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063a5f8-ec31-4a4d-a097-9ed6703d9867 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:54.446244 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063a5f8-ec31-4a4d-a097-9ed6703d9867 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:54.446560 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063a5f8-ec31-4a4d-a097-9ed6703d9867 None admin] PATH_INFO: `/v3/services/network` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:54.447161 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063a5f8-ec31-4a4d-a097-9ed6703d9867 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:54.448638 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063a5f8-ec31-4a4d-a097-9ed6703d9867 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:54.459380 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-a063a5f8-ec31-4a4d-a097-9ed6703d9867 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 20:26:54.459380 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:54.459380 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:26:54.459380 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:26:54.459380 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:26:54.459380 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:26:54.459380 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:26:54.459380 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:26:54.459380 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 20:26:54.459380 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:54.459380 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:26:54.459380 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:54.459380 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:54.459380 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:54.459380 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:54.459380 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:54.459380 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:54.460451 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:54.460451 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:54.460451 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:54.460451 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:54.460451 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:54.460451 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:54.460451 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:26:54.460451 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:26:54.460451 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:26:54.460451 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:26:54.460451 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:54.460451 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:54.460451 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:54.460451 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:54.460451 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:54.460451 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:54.461351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:54.461351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:54.461351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:54.461351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:54.461351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:54.461351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:54.461351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:54.461351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:54.461351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:54.461351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:54.461351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:26:54.461351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:26:54.461351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 20:26:54.461351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:54.461351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 380/778] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:26:54 2022] GET /identity/v3/services/network => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:54.466924 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a600cf-ab19-49e6-a434-15f4c4c47a63 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:54.578675 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a600cf-ab19-49e6-a434-15f4c4c47a63 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:54.592197 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063a5f8-ec31-4a4d-a097-9ed6703d9867 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:54.632235 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28623c70-ac52-4de5-a5ff-b370838885f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:54.633251 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28623c70-ac52-4de5-a5ff-b370838885f1 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:54.633968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28623c70-ac52-4de5-a5ff-b370838885f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:54.635456 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28623c70-ac52-4de5-a5ff-b370838885f1 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:54.636554 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28623c70-ac52-4de5-a5ff-b370838885f1 None admin] RBAC: Adding query filter params (name=network) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:54.638165 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28623c70-ac52-4de5-a5ff-b370838885f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:54.639729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28623c70-ac52-4de5-a5ff-b370838885f1 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:54.644250 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:54.650123 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 399/779] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Aug 22 20:26:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:54.655581 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28623c70-ac52-4de5-a5ff-b370838885f1 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:54.735948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063a5f8-ec31-4a4d-a097-9ed6703d9867 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:54.772339 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32a480-110e-4dd3-9ef6-87ef1ba75460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:54.773044 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32a480-110e-4dd3-9ef6-87ef1ba75460 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:54.773377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32a480-110e-4dd3-9ef6-87ef1ba75460 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:54.773658 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32a480-110e-4dd3-9ef6-87ef1ba75460 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:54.785312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c32a480-110e-4dd3-9ef6-87ef1ba75460 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:54.795715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-5c32a480-110e-4dd3-9ef6-87ef1ba75460 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:26:54.795715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:54.795715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:54.795715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:54.795715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:54.795715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:54.795715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:54.795715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:54.795715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:54.795715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:54.795715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:54.795715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:54.795715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:54.795715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:54.795715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:54.795715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:54.796776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:54.796776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:54.796776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:54.796776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:54.796776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:54.796776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:54.796776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:54.796776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:54.796776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:54.796776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:54.796776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:54.796776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:54.796776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:54.796776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:54.796776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:54.796776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:54.797968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:54.797968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:54.797968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:54.797968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:54.797968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:54.797968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:54.797968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:54.797968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:54.797968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:54.797968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:54.797968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:26:54.797968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:54.797968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 381/780] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 22 20:26:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:54.806019 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32a480-110e-4dd3-9ef6-87ef1ba75460 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:54.827105 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28623c70-ac52-4de5-a5ff-b370838885f1 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:54.843200 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:54.909043 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef5ccd-07e7-4e58-a5d5-f876847075e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:54.910128 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef5ccd-07e7-4e58-a5d5-f876847075e7 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:54.910687 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef5ccd-07e7-4e58-a5d5-f876847075e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:54.911266 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef5ccd-07e7-4e58-a5d5-f876847075e7 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:54.912132 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef5ccd-07e7-4e58-a5d5-f876847075e7 None admin] RBAC: Adding query filter params (type=network) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:54.912637 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef5ccd-07e7-4e58-a5d5-f876847075e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:54.914228 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef5ccd-07e7-4e58-a5d5-f876847075e7 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:54.914361 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32a480-110e-4dd3-9ef6-87ef1ba75460 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:54.930130 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 400/781] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Aug 22 20:26:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:26:54.935959 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef5ccd-07e7-4e58-a5d5-f876847075e7 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:54.956383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c73ddc-6230-4ff7-9b55-4b0eabe25487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:54.957361 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c73ddc-6230-4ff7-9b55-4b0eabe25487 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:54.957888 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c73ddc-6230-4ff7-9b55-4b0eabe25487 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:54.959764 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c73ddc-6230-4ff7-9b55-4b0eabe25487 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:54.960643 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c73ddc-6230-4ff7-9b55-4b0eabe25487 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:54.961182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c73ddc-6230-4ff7-9b55-4b0eabe25487 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:54.963587 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c73ddc-6230-4ff7-9b55-4b0eabe25487 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:54.981306 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 382/782] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:26:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:54.986692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c73ddc-6230-4ff7-9b55-4b0eabe25487 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:55.065086 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:55.114680 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef5ccd-07e7-4e58-a5d5-f876847075e7 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:55.189073 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88b22f-afc9-42c7-ab26-13f723afa938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:55.189713 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88b22f-afc9-42c7-ab26-13f723afa938 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:55.189997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88b22f-afc9-42c7-ab26-13f723afa938 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:55.190263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88b22f-afc9-42c7-ab26-13f723afa938 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:55.190964 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88b22f-afc9-42c7-ab26-13f723afa938 None admin] RBAC: Adding query filter params (interface=public, service_id=91666b0ba6f34e16a95eccb5ac13c1c5, region_id=RegionOne) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:55.191270 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88b22f-afc9-42c7-ab26-13f723afa938 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:55.192635 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc88b22f-afc9-42c7-ab26-13f723afa938 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:55.195522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:55.200057 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c73ddc-6230-4ff7-9b55-4b0eabe25487 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:55.209370 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 401/783] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Aug 22 20:26:54 2022] GET /identity/v3/endpoints?service_id=91666b0ba6f34e16a95eccb5ac13c1c5&interface=public®ion_id=RegionOne => generated 194 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:26:55.210237 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88b22f-afc9-42c7-ab26-13f723afa938 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:55.318454 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ebd53f-6640-4463-aab1-c13804591b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:55.319164 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebd53f-6640-4463-aab1-c13804591b1b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:55.319366 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebd53f-6640-4463-aab1-c13804591b1b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:55.319636 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebd53f-6640-4463-aab1-c13804591b1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:55.322006 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88b22f-afc9-42c7-ab26-13f723afa938 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:55.352437 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ebd53f-6640-4463-aab1-c13804591b1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:55.353938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ebd53f-6640-4463-aab1-c13804591b1b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:55.355998 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:55.362480 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c889379-fb0b-4536-ac53-aa39d890434c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:55.363141 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c889379-fb0b-4536-ac53-aa39d890434c None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:55.363420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c889379-fb0b-4536-ac53-aa39d890434c None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:55.371096 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c889379-fb0b-4536-ac53-aa39d890434c None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:55.371096 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c889379-fb0b-4536-ac53-aa39d890434c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:55.371096 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c889379-fb0b-4536-ac53-aa39d890434c None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:55.372148 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 402/784] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Aug 22 20:26:55 2022] GET /identity/v3/services => generated 772 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:55.396833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-63ebd53f-6640-4463-aab1-c13804591b1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:55.396833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:55.396833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:55.396833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:55.396833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:55.396833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:55.396833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:55.396833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:55.396833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:55.396833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:55.396833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:55.396833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:55.396833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:55.396833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:55.396833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:55.396833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:55.397837 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:55.397837 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:55.397837 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:55.397837 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:55.397837 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:55.397837 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:55.397837 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:55.397837 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:55.397837 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:55.397837 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:55.397837 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:55.397837 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:55.397837 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:55.397837 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:55.397837 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:55.397837 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:55.397837 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:55.398743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:55.398743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:55.398743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:55.398743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 383/785] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 412 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:55.404136 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c889379-fb0b-4536-ac53-aa39d890434c None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:55.565092 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c889379-fb0b-4536-ac53-aa39d890434c None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:55.608063 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93382d9a-887d-40f1-90f6-bc30f5716988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:55.608691 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93382d9a-887d-40f1-90f6-bc30f5716988 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:55.609005 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93382d9a-887d-40f1-90f6-bc30f5716988 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:55.609277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93382d9a-887d-40f1-90f6-bc30f5716988 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:55.609920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93382d9a-887d-40f1-90f6-bc30f5716988 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:55.610284 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93382d9a-887d-40f1-90f6-bc30f5716988 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:55.612180 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93382d9a-887d-40f1-90f6-bc30f5716988 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:55.628290 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 403/786] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:55.634050 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ebd53f-6640-4463-aab1-c13804591b1b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:55.748210 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ebd53f-6640-4463-aab1-c13804591b1b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:55.794398 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91132e4f-cea5-4788-a492-7bb15a848081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:55.799695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91132e4f-cea5-4788-a492-7bb15a848081 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:55.799695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91132e4f-cea5-4788-a492-7bb15a848081 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:55.799695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91132e4f-cea5-4788-a492-7bb15a848081 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:55.809771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91132e4f-cea5-4788-a492-7bb15a848081 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:55.811243 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91132e4f-cea5-4788-a492-7bb15a848081 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:55.826897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-91132e4f-cea5-4788-a492-7bb15a848081 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 20:26:55.826897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:55.826897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:55.826897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:55.826897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:55.826897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:55.826897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:55.826897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:55.826897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:55.826897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:55.826897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:55.826897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:55.826897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:26:55.826897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:26:55.826897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:26:55.826897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:26:55.827872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:55.827872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:55.827872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:26:55.827872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:55.827872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:26:55.827872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:55.827872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:55.827872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:55.827872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:55.827872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:55.827872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:55.827872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:55.827872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:55.827872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:55.827872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:55.827872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:55.827872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:55.827872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:55.828836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:55.828836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:55.828836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:26:55.828836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:26:55.828836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:26:55.828836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:26:55.828836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:26:55.828836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:26:55.828836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 20:26:55.828836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:55.828836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 384/787] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 22 20:26:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:55.833740 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93382d9a-887d-40f1-90f6-bc30f5716988 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:55.927513 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:55.991891 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93382d9a-887d-40f1-90f6-bc30f5716988 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:56.041476 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f32810-95cc-47d7-a865-6ef3de5ad804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:56.042143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f32810-95cc-47d7-a865-6ef3de5ad804 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:56.042416 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f32810-95cc-47d7-a865-6ef3de5ad804 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:56.042689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f32810-95cc-47d7-a865-6ef3de5ad804 None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:56.043411 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f32810-95cc-47d7-a865-6ef3de5ad804 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:56.043710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f32810-95cc-47d7-a865-6ef3de5ad804 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:56.045148 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f32810-95cc-47d7-a865-6ef3de5ad804 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:56.071980 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 404/788] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Aug 22 20:26:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:56.074179 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd25b8f-3e1a-4437-9b05-8386f25caf2e None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:56.074470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd25b8f-3e1a-4437-9b05-8386f25caf2e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:56.074744 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd25b8f-3e1a-4437-9b05-8386f25caf2e None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:56.076690 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 385/789] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:56.077717 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f32810-95cc-47d7-a865-6ef3de5ad804 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:56.082361 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab658ff-4d5d-4480-9e6e-dfd6227cc11a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:56.083657 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab658ff-4d5d-4480-9e6e-dfd6227cc11a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:56.084045 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab658ff-4d5d-4480-9e6e-dfd6227cc11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:56.121766 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-aab658ff-4d5d-4480-9e6e-dfd6227cc11a None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:56.122964 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-aab658ff-4d5d-4480-9e6e-dfd6227cc11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:56.133016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:56.247734 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 386/790] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:26:56.285445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f32810-95cc-47d7-a865-6ef3de5ad804 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:56.309008 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:56.350471 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43614d84-85ef-408a-9efa-0d6015bc3889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:56.351101 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43614d84-85ef-408a-9efa-0d6015bc3889 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:56.351381 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43614d84-85ef-408a-9efa-0d6015bc3889 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:56.351652 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43614d84-85ef-408a-9efa-0d6015bc3889 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:56.370698 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43614d84-85ef-408a-9efa-0d6015bc3889 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:56.372155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43614d84-85ef-408a-9efa-0d6015bc3889 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:56.393961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-43614d84-85ef-408a-9efa-0d6015bc3889 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:56.393961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:56.393961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:56.393961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:56.393961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:56.393961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:56.393961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:56.393961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:56.393961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:56.393961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:56.393961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:56.393961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:56.393961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:56.393961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:56.393961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:56.393961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:56.394931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:56.394931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:56.394931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:56.394931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:56.394931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:56.394931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:56.394931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:56.394931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:56.394931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:56.394931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:56.394931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:56.394931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:56.394931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:56.394931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:56.394931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:56.394931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:56.394931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:56.396426 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:56.396426 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:56.396426 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:56.396426 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 405/791] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:56.401122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab658ff-4d5d-4480-9e6e-dfd6227cc11a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:56.531770 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab658ff-4d5d-4480-9e6e-dfd6227cc11a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:56.551762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f82b02-3feb-442d-8173-b259ed2aa427 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:56.552053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f82b02-3feb-442d-8173-b259ed2aa427 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:56.552311 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f82b02-3feb-442d-8173-b259ed2aa427 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:56.553799 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 406/792] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:56.563641 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213aecb8-9389-4f2d-8958-8eae0e6ac76a None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:56.563918 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213aecb8-9389-4f2d-8958-8eae0e6ac76a None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:56.564186 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213aecb8-9389-4f2d-8958-8eae0e6ac76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:56.579529 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1dc6da-bf02-4c18-9d2c-481d59c7b58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:56.580748 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1dc6da-bf02-4c18-9d2c-481d59c7b58e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:56.588966 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1dc6da-bf02-4c18-9d2c-481d59c7b58e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:56.588966 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1dc6da-bf02-4c18-9d2c-481d59c7b58e None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:56.588966 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1dc6da-bf02-4c18-9d2c-481d59c7b58e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:56.588966 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1dc6da-bf02-4c18-9d2c-481d59c7b58e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:56.588966 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1dc6da-bf02-4c18-9d2c-481d59c7b58e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:56.589304 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-213aecb8-9389-4f2d-8958-8eae0e6ac76a None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:56.589304 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-213aecb8-9389-4f2d-8958-8eae0e6ac76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:56.597753 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:56.601833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 387/793] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:56.603458 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2075337-5714-40b7-8ed3-484aaf9d118c None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:56.603966 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2075337-5714-40b7-8ed3-484aaf9d118c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:56.604460 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2075337-5714-40b7-8ed3-484aaf9d118c None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:56.610288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 388/794] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:56.610288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2075337-5714-40b7-8ed3-484aaf9d118c None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:56.666723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 407/795] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:26:56.667959 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e933fd-2aa8-43c3-9343-09deae87a9d8 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:56.668245 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e933fd-2aa8-43c3-9343-09deae87a9d8 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:56.668515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e933fd-2aa8-43c3-9343-09deae87a9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:56.698779 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-84e933fd-2aa8-43c3-9343-09deae87a9d8 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:56.701251 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-84e933fd-2aa8-43c3-9343-09deae87a9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:56.720219 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2075337-5714-40b7-8ed3-484aaf9d118c None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:56.757225 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfb623-5d56-4dcf-9e1f-d34ae5d2fd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:56.757858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfb623-5d56-4dcf-9e1f-d34ae5d2fd3a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:56.758138 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfb623-5d56-4dcf-9e1f-d34ae5d2fd3a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:56.758410 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfb623-5d56-4dcf-9e1f-d34ae5d2fd3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:56.765959 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abfb623-5d56-4dcf-9e1f-d34ae5d2fd3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:56.767810 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abfb623-5d56-4dcf-9e1f-d34ae5d2fd3a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:56.779187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-3abfb623-5d56-4dcf-9e1f-d34ae5d2fd3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:56.779187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:56.779187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:56.779187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:56.779187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:56.779187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:56.779187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:56.779187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:56.779187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:56.779187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:56.779187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:56.779187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:56.779187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:26:56.779187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:26:56.779187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:26:56.780076 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:26:56.780076 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:56.780076 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:56.780076 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:56.780076 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:56.780076 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:56.780076 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:56.780076 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:56.780076 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:56.780076 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:56.780076 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:56.780076 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:56.780076 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:56.780076 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:56.780076 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:56.780076 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:56.780076 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:56.780979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:26:56.780979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:26:56.780979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:26:56.780979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:26:56.780979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:26:56.780979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:26:56.780979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:56.780979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:56.785057 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 389/796] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:26:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:56.786039 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfb623-5d56-4dcf-9e1f-d34ae5d2fd3a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:56.795752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 408/797] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:26:56.796919 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e933fd-2aa8-43c3-9343-09deae87a9d8 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:56.840303 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:56.882489 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:56.952886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfb623-5d56-4dcf-9e1f-d34ae5d2fd3a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:56.967960 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e933fd-2aa8-43c3-9343-09deae87a9d8 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:56.990859 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6b05d-8436-4fcb-9fda-63a796b73438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:56.991499 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6b05d-8436-4fcb-9fda-63a796b73438 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:56.991780 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6b05d-8436-4fcb-9fda-63a796b73438 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:56.992051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6b05d-8436-4fcb-9fda-63a796b73438 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:56.993060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6b05d-8436-4fcb-9fda-63a796b73438 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:56.994225 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6b05d-8436-4fcb-9fda-63a796b73438 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:57.004626 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-4ad6b05d-8436-4fcb-9fda-63a796b73438 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 20:26:57.004626 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:57.004626 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:26:57.004626 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:26:57.004626 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:26:57.004626 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:26:57.004626 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:26:57.004626 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:26:57.004626 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 20:26:57.004626 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:57.004626 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:26:57.004626 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:57.004626 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:57.004626 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:57.004626 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:57.004626 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:57.004626 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:57.005698 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:57.005698 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:57.005698 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:57.005698 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:57.005698 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:57.005698 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:57.005698 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:26:57.005698 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:26:57.005698 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:26:57.005698 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:26:57.005698 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:57.005698 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:57.005698 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:57.005698 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:57.005698 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:57.005698 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:57.006522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:57.006522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:57.006522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:57.006522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:57.006522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:57.006522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:57.006522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:57.006522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:57.006522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:57.006522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:57.006522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:26:57.006522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:26:57.006522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 20:26:57.006522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:57.006522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 390/798] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Aug 22 20:26:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:57.007292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6b05d-8436-4fcb-9fda-63a796b73438 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:57.012911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f129ae9-7c84-45c5-a114-54e9c113bc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:57.013778 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f129ae9-7c84-45c5-a114-54e9c113bc23 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:57.014257 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f129ae9-7c84-45c5-a114-54e9c113bc23 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:57.014836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f129ae9-7c84-45c5-a114-54e9c113bc23 None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:57.015868 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f129ae9-7c84-45c5-a114-54e9c113bc23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:57.016430 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f129ae9-7c84-45c5-a114-54e9c113bc23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:57.018202 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f129ae9-7c84-45c5-a114-54e9c113bc23 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:57.031657 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 409/799] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 22 20:26:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:57.032823 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f129ae9-7c84-45c5-a114-54e9c113bc23 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:57.121456 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:57.126511 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6b05d-8436-4fcb-9fda-63a796b73438 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:57.140137 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f129ae9-7c84-45c5-a114-54e9c113bc23 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:57.153002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:57.164874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f6bbc-0096-41d9-bd46-104b1ba1fcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:57.165506 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f6bbc-0096-41d9-bd46-104b1ba1fcd4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:57.165785 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f6bbc-0096-41d9-bd46-104b1ba1fcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:57.166086 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f6bbc-0096-41d9-bd46-104b1ba1fcd4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:57.176503 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f6bbc-0096-41d9-bd46-104b1ba1fcd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:57.177864 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3ad81-a2b6-4164-96d1-479a48333476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:57.178461 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3ad81-a2b6-4164-96d1-479a48333476 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:57.178735 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3ad81-a2b6-4164-96d1-479a48333476 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:57.179007 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3ad81-a2b6-4164-96d1-479a48333476 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:57.179623 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3ad81-a2b6-4164-96d1-479a48333476 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:57.179919 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3ad81-a2b6-4164-96d1-479a48333476 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:57.181307 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3ad81-a2b6-4164-96d1-479a48333476 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:57.181427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-ff8f6bbc-0096-41d9-bd46-104b1ba1fcd4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:26:57.181427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:57.181427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:57.181427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:57.181427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:57.181427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:57.181427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:57.181427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:57.181427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:57.181427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:57.181427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:57.181427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:57.181427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:57.181427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:57.181427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:57.181427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:57.182273 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:57.182273 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:57.182273 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:57.182273 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:57.182273 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:57.182273 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:57.182273 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:57.182273 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:57.182273 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:57.182273 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:57.182273 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:57.182273 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:57.182273 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:57.182273 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:57.182273 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:57.182273 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:57.183117 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:57.183117 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:57.183117 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:57.183117 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:57.183117 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:57.183117 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:57.183117 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:57.183117 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:57.183117 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:57.183117 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:57.183117 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:26:57.183117 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:57.183117 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 391/800] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 22 20:26:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:57.184613 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f6bbc-0096-41d9-bd46-104b1ba1fcd4 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:57.190998 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 410/801] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Aug 22 20:26:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:57.191795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3ad81-a2b6-4164-96d1-479a48333476 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:57.287216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f6bbc-0096-41d9-bd46-104b1ba1fcd4 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:57.305382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3ad81-a2b6-4164-96d1-479a48333476 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:57.320747 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab3be2-1b62-424b-8187-e821d1246056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:57.321409 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab3be2-1b62-424b-8187-e821d1246056 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:57.321691 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab3be2-1b62-424b-8187-e821d1246056 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:57.321970 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab3be2-1b62-424b-8187-e821d1246056 None admin] PATH_INFO: `/v3/projects/783c362712d34405ab827e3f00a67995/users/907607fd209b416ba9b68512772c1d17/roles/e3faa0474c054da6bb4d8910a4e40bff` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:57.323866 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab3be2-1b62-424b-8187-e821d1246056 None admin] RBAC: Authorizing `identity:create_grant(project_id=783c362712d34405ab827e3f00a67995, user_id=907607fd209b416ba9b68512772c1d17, role_id=e3faa0474c054da6bb4d8910a4e40bff)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:57.325348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab3be2-1b62-424b-8187-e821d1246056 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:57.341639 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd09fd-032e-41e0-9298-48bd29c8a749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:57.342332 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd09fd-032e-41e0-9298-48bd29c8a749 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:57.342518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd09fd-032e-41e0-9298-48bd29c8a749 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:57.342781 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd09fd-032e-41e0-9298-48bd29c8a749 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:57.355468 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd09fd-032e-41e0-9298-48bd29c8a749 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:26:57.360512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-b7dd09fd-032e-41e0-9298-48bd29c8a749 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:26:57.360512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:57.360512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:57.360512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:57.360512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:57.360512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:57.360512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:57.360512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:57.360512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:57.360512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:57.360512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:57.360512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:57.360512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:26:57.360512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:26:57.360512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:26:57.360512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:26:57.361632 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:26:57.361632 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:26:57.361632 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:26:57.361632 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:26:57.361632 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:57.361632 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:57.361632 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:57.361632 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:57.361632 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:57.361632 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:57.361632 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:57.361632 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:57.361632 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:57.361632 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:57.361632 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:57.361632 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:57.362587 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:57.362587 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:57.362587 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:57.362587 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:57.362587 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:26:57.362587 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:26:57.362587 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:26:57.362587 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:26:57.362587 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:26:57.362587 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:26:57.362587 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:26:57.362587 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:57.362587 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 411/802] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 22 20:26:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:57.363382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd09fd-032e-41e0-9298-48bd29c8a749 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:57.373010 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:57.396333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 392/803] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 22 20:26:57 2022] PUT /identity/v3/projects/783c362712d34405ab827e3f00a67995/users/907607fd209b416ba9b68512772c1d17/roles/e3faa0474c054da6bb4d8910a4e40bff => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:26:57.397484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab3be2-1b62-424b-8187-e821d1246056 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:57.466175 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:57.514572 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd09fd-032e-41e0-9298-48bd29c8a749 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:57.534835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab3be2-1b62-424b-8187-e821d1246056 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:57.564081 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4a285-1d37-4160-b5e2-9cb13d74729d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:57.565374 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4a285-1d37-4160-b5e2-9cb13d74729d None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:57.565646 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4a285-1d37-4160-b5e2-9cb13d74729d None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:57.566229 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4a285-1d37-4160-b5e2-9cb13d74729d None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:57.567223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd4a285-1d37-4160-b5e2-9cb13d74729d None admin] RBAC: Adding query filter params (name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:57.567551 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd4a285-1d37-4160-b5e2-9cb13d74729d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:57.569466 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd4a285-1d37-4160-b5e2-9cb13d74729d None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:57.579620 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52deb86d-0996-42ff-9f3f-b2ce50db62f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:57.581175 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52deb86d-0996-42ff-9f3f-b2ce50db62f4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:57.581492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52deb86d-0996-42ff-9f3f-b2ce50db62f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:57.581729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52deb86d-0996-42ff-9f3f-b2ce50db62f4 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:57.584279 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52deb86d-0996-42ff-9f3f-b2ce50db62f4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:57.584279 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52deb86d-0996-42ff-9f3f-b2ce50db62f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:57.584445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52deb86d-0996-42ff-9f3f-b2ce50db62f4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:57.584968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 412/804] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 22 20:26:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:57.586093 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4a285-1d37-4160-b5e2-9cb13d74729d None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:57.591747 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 393/805] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Aug 22 20:26:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:57.592725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52deb86d-0996-42ff-9f3f-b2ce50db62f4 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:57.664297 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:57.699411 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4a285-1d37-4160-b5e2-9cb13d74729d None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:57.734540 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52deb86d-0996-42ff-9f3f-b2ce50db62f4 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:57.737037 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300ebfb-0e08-4e84-9d1b-5b7f1bc377ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:57.737807 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300ebfb-0e08-4e84-9d1b-5b7f1bc377ef None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:57.738177 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300ebfb-0e08-4e84-9d1b-5b7f1bc377ef None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:57.738565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300ebfb-0e08-4e84-9d1b-5b7f1bc377ef None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:57.739325 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300ebfb-0e08-4e84-9d1b-5b7f1bc377ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:57.739719 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300ebfb-0e08-4e84-9d1b-5b7f1bc377ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:57.741276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7300ebfb-0e08-4e84-9d1b-5b7f1bc377ef None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:57.744994 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:57.750784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 413/806] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:26:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:57.752392 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300ebfb-0e08-4e84-9d1b-5b7f1bc377ef None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:57.777834 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55bc6d-c35e-4f77-b143-409c0eb080c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:57.778470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55bc6d-c35e-4f77-b143-409c0eb080c6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:57.778752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55bc6d-c35e-4f77-b143-409c0eb080c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:57.779034 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55bc6d-c35e-4f77-b143-409c0eb080c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:57.794036 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55bc6d-c35e-4f77-b143-409c0eb080c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:57.795907 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55bc6d-c35e-4f77-b143-409c0eb080c6 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:57.817565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-db55bc6d-c35e-4f77-b143-409c0eb080c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:57.817565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:57.817565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:57.817565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:57.817565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:57.817565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:57.817565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:57.817565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:57.817565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:57.817565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:57.817565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:57.817565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:57.817565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:57.817565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:57.817565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:57.817565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:57.818521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:57.818521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:57.818521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:57.818521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:57.818521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:57.818521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:57.818521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:57.818521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:57.818521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:57.818521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:57.818521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:57.818521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:57.818521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:57.818521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:57.818521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:57.818521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:57.818521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:57.819378 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:57.819378 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:57.819378 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:57.823363 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 394/807] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:57.824227 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55bc6d-c35e-4f77-b143-409c0eb080c6 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:57.878540 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300ebfb-0e08-4e84-9d1b-5b7f1bc377ef None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:57.911729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:57.922224 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbb84c-8aa0-4780-8f5d-359aac242341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:57.922224 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbb84c-8aa0-4780-8f5d-359aac242341 None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:57.922224 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbb84c-8aa0-4780-8f5d-359aac242341 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:57.922224 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbb84c-8aa0-4780-8f5d-359aac242341 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:57.922632 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbb84c-8aa0-4780-8f5d-359aac242341 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:57.922632 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbb84c-8aa0-4780-8f5d-359aac242341 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:57.931364 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55bc6d-c35e-4f77-b143-409c0eb080c6 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:57.967587 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6c573-6baf-44dc-bdf5-802d496eb186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:57.968212 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6c573-6baf-44dc-bdf5-802d496eb186 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:57.968504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6c573-6baf-44dc-bdf5-802d496eb186 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:57.968788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6c573-6baf-44dc-bdf5-802d496eb186 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:57.979805 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6c573-6baf-44dc-bdf5-802d496eb186 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:57.985152 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6c573-6baf-44dc-bdf5-802d496eb186 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:57.995821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-68f6c573-6baf-44dc-bdf5-802d496eb186 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:57.995821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:57.995821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:57.995821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:57.995821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:57.995821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:57.995821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:57.995821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:57.995821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:57.995821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:57.995821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:57.995821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:57.995821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:57.995821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:57.995821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:57.995821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:57.996897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:57.996897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:57.996897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:57.996897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:57.996897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:57.996897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:57.996897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:57.996897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:57.996897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:57.996897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:57.996897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:57.996897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:57.996897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:57.996897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:57.996897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:57.996897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:57.996897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:57.997860 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:57.997860 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:57.997860 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:57.997860 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 395/808] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:57.997860 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6c573-6baf-44dc-bdf5-802d496eb186 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:58.008017 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 414/809] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 22 20:26:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:26:58.009359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44bcab-0847-43f5-97ef-6f723c105892 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:58.011059 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44bcab-0847-43f5-97ef-6f723c105892 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:58.011059 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44bcab-0847-43f5-97ef-6f723c105892 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:58.015719 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 415/810] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:58.016768 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44bcab-0847-43f5-97ef-6f723c105892 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:58.018457 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:58.118312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6c573-6baf-44dc-bdf5-802d496eb186 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:58.159610 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44bcab-0847-43f5-97ef-6f723c105892 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:58.163766 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149caac5-e5e9-49d0-b6ad-083d8bf40e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:58.164215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149caac5-e5e9-49d0-b6ad-083d8bf40e2b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:58.164566 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149caac5-e5e9-49d0-b6ad-083d8bf40e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:58.164933 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149caac5-e5e9-49d0-b6ad-083d8bf40e2b None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:58.165934 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149caac5-e5e9-49d0-b6ad-083d8bf40e2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:58.165934 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149caac5-e5e9-49d0-b6ad-083d8bf40e2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:58.167490 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149caac5-e5e9-49d0-b6ad-083d8bf40e2b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:58.182468 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 396/811] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:58.183809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9c66f-b447-4306-9b37-edd18eefea2c None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:58.184161 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9c66f-b447-4306-9b37-edd18eefea2c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:58.184501 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9c66f-b447-4306-9b37-edd18eefea2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:58.202953 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-35b9c66f-b447-4306-9b37-edd18eefea2c None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:58.204198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-35b9c66f-b447-4306-9b37-edd18eefea2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:58.209461 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08b7b1-e49e-4f2e-8707-2f4dc368cfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:58.210068 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08b7b1-e49e-4f2e-8707-2f4dc368cfad None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:58.210348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08b7b1-e49e-4f2e-8707-2f4dc368cfad None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:58.210619 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08b7b1-e49e-4f2e-8707-2f4dc368cfad None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:58.211261 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08b7b1-e49e-4f2e-8707-2f4dc368cfad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:58.211560 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08b7b1-e49e-4f2e-8707-2f4dc368cfad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:58.213397 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08b7b1-e49e-4f2e-8707-2f4dc368cfad None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:58.226699 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 416/812] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:58.227846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08b7b1-e49e-4f2e-8707-2f4dc368cfad None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:58.282580 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:58.285292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:58.289269 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 397/813] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:26:58.289994 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9c66f-b447-4306-9b37-edd18eefea2c None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:58.386449 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08b7b1-e49e-4f2e-8707-2f4dc368cfad None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:58.452376 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3c0a4-1988-42bd-9ce4-6f29eb2e7522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:58.453348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3c0a4-1988-42bd-9ce4-6f29eb2e7522 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:58.453826 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3c0a4-1988-42bd-9ce4-6f29eb2e7522 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:58.454272 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3c0a4-1988-42bd-9ce4-6f29eb2e7522 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:58.473477 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd3c0a4-1988-42bd-9ce4-6f29eb2e7522 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:58.474945 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd3c0a4-1988-42bd-9ce4-6f29eb2e7522 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:58.481773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9c66f-b447-4306-9b37-edd18eefea2c None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:58.501712 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-6fd3c0a4-1988-42bd-9ce4-6f29eb2e7522 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 20:26:58.501712 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:58.501712 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:58.501712 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:58.501712 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:58.501712 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:58.501712 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:58.501712 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:58.501712 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:58.501712 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:58.501712 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:58.501712 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:58.501712 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:26:58.501712 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:26:58.501712 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:26:58.501712 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:26:58.503216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:58.503216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:58.503216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:26:58.503216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:58.503216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:26:58.503216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:58.503216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:58.503216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:58.503216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:58.503216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:58.503216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:58.503216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:58.503216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:58.503216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:58.503216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:58.503216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:58.503216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:58.503216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:58.504259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:58.504259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:58.504259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:26:58.504259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:26:58.504259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:26:58.504259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:26:58.504259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:26:58.504259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:26:58.504259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 20:26:58.504259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:58.504259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 417/814] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Aug 22 20:26:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:58.513581 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3c0a4-1988-42bd-9ce4-6f29eb2e7522 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:58.526820 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507057f9-0530-414c-85ed-c0cf1b6c3636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:58.527704 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507057f9-0530-414c-85ed-c0cf1b6c3636 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:58.528159 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507057f9-0530-414c-85ed-c0cf1b6c3636 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:58.528701 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507057f9-0530-414c-85ed-c0cf1b6c3636 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:58.537171 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507057f9-0530-414c-85ed-c0cf1b6c3636 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:58.539388 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507057f9-0530-414c-85ed-c0cf1b6c3636 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:58.552173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-507057f9-0530-414c-85ed-c0cf1b6c3636 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:26:58.552173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:58.552173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:58.552173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:58.552173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:58.552173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:58.552173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:58.552173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:58.552173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:58.552173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:58.552173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:58.552173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:58.552173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:26:58.552173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:26:58.552173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:26:58.552173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:26:58.553383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:58.553383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:58.553383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:26:58.553383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:58.553383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:26:58.553383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:26:58.553383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:58.553383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:58.553383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:58.553383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:58.553383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:58.553383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:58.553383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:58.553383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:58.553383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:58.553383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:58.553383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:58.553383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:58.554340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:58.554340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:58.554340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:26:58.554340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:26:58.554340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:26:58.554340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:26:58.554340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:26:58.554340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:26:58.554340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:26:58.554340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:58.556585 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 398/815] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Aug 22 20:26:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:58.562606 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507057f9-0530-414c-85ed-c0cf1b6c3636 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:58.644693 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:58.691248 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3c0a4-1988-42bd-9ce4-6f29eb2e7522 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:58.693074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:58.699808 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507057f9-0530-414c-85ed-c0cf1b6c3636 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:58.729327 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb281b6-7bd3-4dd9-941e-1ead39bc1f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:58.729909 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb281b6-7bd3-4dd9-941e-1ead39bc1f2f None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:58.730285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb281b6-7bd3-4dd9-941e-1ead39bc1f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:58.730585 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb281b6-7bd3-4dd9-941e-1ead39bc1f2f None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:58.731633 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb281b6-7bd3-4dd9-941e-1ead39bc1f2f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:58.731752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb281b6-7bd3-4dd9-941e-1ead39bc1f2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:58.733219 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb281b6-7bd3-4dd9-941e-1ead39bc1f2f None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:58.748499 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1669d87-7524-4ba1-9c68-3b1245b9b49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:58.749899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1669d87-7524-4ba1-9c68-3b1245b9b49e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:58.750358 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1669d87-7524-4ba1-9c68-3b1245b9b49e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:58.751047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1669d87-7524-4ba1-9c68-3b1245b9b49e None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:58.752596 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1669d87-7524-4ba1-9c68-3b1245b9b49e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:58.753094 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1669d87-7524-4ba1-9c68-3b1245b9b49e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:58.754090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 418/816] 10.222.0.62 () {56 vars in 1149 bytes} [Mon Aug 22 20:26:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:58.755029 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1669d87-7524-4ba1-9c68-3b1245b9b49e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:58.755138 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb281b6-7bd3-4dd9-941e-1ead39bc1f2f None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:58.782574 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 399/817] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Aug 22 20:26:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:58.782574 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1669d87-7524-4ba1-9c68-3b1245b9b49e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:58.878208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb281b6-7bd3-4dd9-941e-1ead39bc1f2f None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:58.912287 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1669d87-7524-4ba1-9c68-3b1245b9b49e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:58.926439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4af29-aaf3-4af3-b865-85cff596db46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:58.927129 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4af29-aaf3-4af3-b865-85cff596db46 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:58.927418 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4af29-aaf3-4af3-b865-85cff596db46 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:58.927690 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4af29-aaf3-4af3-b865-85cff596db46 None admin] PATH_INFO: `/v3/services/network` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:58.928533 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4af29-aaf3-4af3-b865-85cff596db46 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:58.930423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4af29-aaf3-4af3-b865-85cff596db46 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:58.932318 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:58.943046 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-66b4af29-aaf3-4af3-b865-85cff596db46 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 20:26:58.943046 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:58.943046 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:26:58.943046 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:26:58.943046 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:26:58.943046 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:26:58.943046 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:26:58.943046 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:26:58.943046 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 20:26:58.943046 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:58.943046 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:26:58.943046 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:58.943046 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:58.943046 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:58.943046 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:58.943046 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:58.943046 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:58.947545 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:58.947545 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:58.947545 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:58.947545 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:58.947545 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:58.947545 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:58.947545 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:26:58.947545 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:26:58.947545 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:26:58.947545 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:26:58.947545 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:58.947545 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:58.947545 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:58.947545 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:58.947545 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:58.947545 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:58.948389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:58.948389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:58.948389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:58.948389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:58.948389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:58.948389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:58.948389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:58.948389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:58.948389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:58.948389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:58.948389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:26:58.948389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:26:58.948389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 20:26:58.948389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:58.948389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 419/818] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:26:58 2022] GET /identity/v3/services/network => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:58.949737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4af29-aaf3-4af3-b865-85cff596db46 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:58.956064 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac7ec7-1d74-4d5f-ae50-30f4f25b7048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:58.957033 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac7ec7-1d74-4d5f-ae50-30f4f25b7048 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:58.957563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac7ec7-1d74-4d5f-ae50-30f4f25b7048 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:58.958012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac7ec7-1d74-4d5f-ae50-30f4f25b7048 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:58.969386 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac7ec7-1d74-4d5f-ae50-30f4f25b7048 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:58.971788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac7ec7-1d74-4d5f-ae50-30f4f25b7048 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:58.976993 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:58.992558 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-b3ac7ec7-1d74-4d5f-ae50-30f4f25b7048 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:58.992558 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:58.992558 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:58.992558 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:58.992558 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:58.992558 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:58.992558 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:58.992558 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:58.992558 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:58.992558 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:58.992558 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:58.992558 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:58.992558 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:58.992558 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:58.992558 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:58.992558 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:58.993737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:58.993737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:58.993737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:58.993737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:58.993737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:58.993737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:58.993737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:58.993737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:58.993737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:58.993737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:58.993737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:58.993737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:58.993737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:58.993737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:58.993737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:58.993737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:58.993737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:58.994821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:58.994821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:58.994821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:58.994821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 400/819] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:58.997466 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac7ec7-1d74-4d5f-ae50-30f4f25b7048 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:59.067571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4af29-aaf3-4af3-b865-85cff596db46 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:59.104128 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac7ec7-1d74-4d5f-ae50-30f4f25b7048 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:59.106359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88e99d-8f0e-4190-aa6c-0ae03bcaaccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:59.107256 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88e99d-8f0e-4190-aa6c-0ae03bcaaccb None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:59.107708 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88e99d-8f0e-4190-aa6c-0ae03bcaaccb None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:59.108198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88e99d-8f0e-4190-aa6c-0ae03bcaaccb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:59.139992 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3849e5-b469-4a96-b0db-0e6183a8c207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:59.140749 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3849e5-b469-4a96-b0db-0e6183a8c207 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:59.141134 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3849e5-b469-4a96-b0db-0e6183a8c207 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:59.141451 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3849e5-b469-4a96-b0db-0e6183a8c207 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:59.142126 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3849e5-b469-4a96-b0db-0e6183a8c207 None admin] RBAC: Adding query filter params (name=network) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:59.143057 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3849e5-b469-4a96-b0db-0e6183a8c207 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:59.144602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3849e5-b469-4a96-b0db-0e6183a8c207 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:59.149971 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 401/820] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Aug 22 20:26:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:59.150448 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3849e5-b469-4a96-b0db-0e6183a8c207 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:59.182342 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:59.188193 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a88e99d-8f0e-4190-aa6c-0ae03bcaaccb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:59.191013 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a88e99d-8f0e-4190-aa6c-0ae03bcaaccb None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:59.217514 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:59.254925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3849e5-b469-4a96-b0db-0e6183a8c207 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:59.290429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506d1ed-e957-4122-8a1f-89d80ecbf0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:59.291157 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506d1ed-e957-4122-8a1f-89d80ecbf0f9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:59.291580 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506d1ed-e957-4122-8a1f-89d80ecbf0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:59.291891 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506d1ed-e957-4122-8a1f-89d80ecbf0f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:59.292587 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506d1ed-e957-4122-8a1f-89d80ecbf0f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:59.293006 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506d1ed-e957-4122-8a1f-89d80ecbf0f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:59.294466 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506d1ed-e957-4122-8a1f-89d80ecbf0f9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:59.310543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 420/822] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:26:58 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 20:26:59.311996 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88e99d-8f0e-4190-aa6c-0ae03bcaaccb None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:59.312426 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 402/822] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:59.313519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506d1ed-e957-4122-8a1f-89d80ecbf0f9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:59.410089 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:59.419967 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506d1ed-e957-4122-8a1f-89d80ecbf0f9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:59.428921 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88e99d-8f0e-4190-aa6c-0ae03bcaaccb None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:59.453757 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:59.459592 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f6d50-ffe1-4d92-8dbd-90c35a8a3131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:59.460470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f6d50-ffe1-4d92-8dbd-90c35a8a3131 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:59.461148 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f6d50-ffe1-4d92-8dbd-90c35a8a3131 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:59.461496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f6d50-ffe1-4d92-8dbd-90c35a8a3131 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:59.465571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323a85c-ddb0-4fc0-a078-9a12b6d8ae4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:59.466240 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323a85c-ddb0-4fc0-a078-9a12b6d8ae4d None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:59.466573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323a85c-ddb0-4fc0-a078-9a12b6d8ae4d None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:59.467672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323a85c-ddb0-4fc0-a078-9a12b6d8ae4d None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:59.467672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323a85c-ddb0-4fc0-a078-9a12b6d8ae4d None admin] RBAC: Adding query filter params (type=network) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:59.467965 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323a85c-ddb0-4fc0-a078-9a12b6d8ae4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:59.469274 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f6d50-ffe1-4d92-8dbd-90c35a8a3131 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:59.469477 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3323a85c-ddb0-4fc0-a078-9a12b6d8ae4d None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:59.471682 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f6d50-ffe1-4d92-8dbd-90c35a8a3131 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:59.475203 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 421/823] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Aug 22 20:26:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:59.476035 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323a85c-ddb0-4fc0-a078-9a12b6d8ae4d None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:59.486711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-036f6d50-ffe1-4d92-8dbd-90c35a8a3131 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:59.486711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:59.486711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:59.486711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:59.486711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:59.486711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:59.486711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:59.486711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:59.486711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:59.486711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:59.486711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:59.486711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:59.486711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:26:59.486711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:26:59.486711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:26:59.488155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:26:59.488155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:59.488155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:59.488155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:59.488155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:59.488155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:59.488155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:59.488155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:59.488155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:59.488155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:59.488155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:59.488155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:59.488155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:59.488155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:59.488155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:59.488155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:59.488155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:59.489280 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:26:59.489280 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:26:59.489280 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:26:59.489280 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:26:59.489280 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:26:59.489280 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:26:59.489280 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:26:59.489280 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:26:59.489280 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 403/824] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:26:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:59.489871 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b5a50-3bc2-4b54-9099-af89f0f8a50a None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:59.489951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b5a50-3bc2-4b54-9099-af89f0f8a50a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:59.495171 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b5a50-3bc2-4b54-9099-af89f0f8a50a None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:59.495513 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 404/825] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:26:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:26:59.496229 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b5a50-3bc2-4b54-9099-af89f0f8a50a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:59.601370 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b5a50-3bc2-4b54-9099-af89f0f8a50a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:59.601880 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3323a85c-ddb0-4fc0-a078-9a12b6d8ae4d None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:59.638879 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11784975-042f-4847-aa83-d1f95bab1361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:59.639672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11784975-042f-4847-aa83-d1f95bab1361 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:59.640056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11784975-042f-4847-aa83-d1f95bab1361 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:59.640291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f6697-79f1-4f73-ab24-eed51f368787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:59.640529 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11784975-042f-4847-aa83-d1f95bab1361 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:59.640926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f6697-79f1-4f73-ab24-eed51f368787 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:59.641247 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f6697-79f1-4f73-ab24-eed51f368787 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:59.641524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f6697-79f1-4f73-ab24-eed51f368787 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:59.642126 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f6697-79f1-4f73-ab24-eed51f368787 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:59.644002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f6697-79f1-4f73-ab24-eed51f368787 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:59.652395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11784975-042f-4847-aa83-d1f95bab1361 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:59.653844 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11784975-042f-4847-aa83-d1f95bab1361 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:59.667869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-11784975-042f-4847-aa83-d1f95bab1361 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:59.667869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:26:59.667869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:26:59.667869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:26:59.667869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:26:59.667869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:26:59.667869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:26:59.667869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:26:59.667869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:26:59.667869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:26:59.667869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:26:59.667869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:26:59.667869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:26:59.667869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:26:59.667869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:26:59.667869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:26:59.673137 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:26:59.673137 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:26:59.673137 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:26:59.673137 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:26:59.673137 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:26:59.673137 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:26:59.673137 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:26:59.673137 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:26:59.673137 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:26:59.673137 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:26:59.673137 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:26:59.673137 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:26:59.673137 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:26:59.673137 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:26:59.673137 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:26:59.673137 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:26:59.673137 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:26:59.674711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:26:59.674711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:26:59.674711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:26:59.674711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 422/826] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:26:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:26:59.674711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11784975-042f-4847-aa83-d1f95bab1361 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:59.715114 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:59.730873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 405/827] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 22 20:26:59 2022] POST /identity/v3/endpoints => generated 337 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:26:59.730873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66cfde-872e-418c-be7f-56cfa7db7c43 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:59.730873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66cfde-872e-418c-be7f-56cfa7db7c43 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:59.730873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea66cfde-872e-418c-be7f-56cfa7db7c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:59.745023 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-ea66cfde-872e-418c-be7f-56cfa7db7c43 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:26:59.746375 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ea66cfde-872e-418c-be7f-56cfa7db7c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:26:59.748998 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:26:59.806800 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11784975-042f-4847-aa83-d1f95bab1361 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:26:59.863425 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a13b4-b210-40e8-b278-dab9f6a730e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:26:59.863953 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a13b4-b210-40e8-b278-dab9f6a730e7 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:26:59.864384 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 406/828] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:26:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:26:59.865366 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66cfde-872e-418c-be7f-56cfa7db7c43 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:26:59.869047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a13b4-b210-40e8-b278-dab9f6a730e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:26:59.869376 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a13b4-b210-40e8-b278-dab9f6a730e7 None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:26:59.870192 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a13b4-b210-40e8-b278-dab9f6a730e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:26:59.870651 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a13b4-b210-40e8-b278-dab9f6a730e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:26:59.872214 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a13b4-b210-40e8-b278-dab9f6a730e7 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:26:59.897368 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 423/829] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 22 20:26:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:26:59.903437 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a13b4-b210-40e8-b278-dab9f6a730e7 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:00.001129 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea66cfde-872e-418c-be7f-56cfa7db7c43 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:00.010677 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:00.017212 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a13b4-b210-40e8-b278-dab9f6a730e7 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:00.048366 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f2187-b841-446c-9e15-dc69ba8b2434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:00.049467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f2187-b841-446c-9e15-dc69ba8b2434 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:00.049938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f2187-b841-446c-9e15-dc69ba8b2434 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:00.050214 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f2187-b841-446c-9e15-dc69ba8b2434 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:00.051137 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f2187-b841-446c-9e15-dc69ba8b2434 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:00.051443 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f2187-b841-446c-9e15-dc69ba8b2434 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:00.053174 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f2187-b841-446c-9e15-dc69ba8b2434 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:00.055058 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:00.063726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16a463-5e83-4efc-89db-aeb22959b83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:00.065288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16a463-5e83-4efc-89db-aeb22959b83b None admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:00.066215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16a463-5e83-4efc-89db-aeb22959b83b None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:00.066866 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16a463-5e83-4efc-89db-aeb22959b83b None admin] PATH_INFO: `/v3/projects/783c362712d34405ab827e3f00a67995/users/51ed4c996cde4e88be26544c48200695/roles/38bb7e6ed5854439aeaf5996eb6892f6` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:00.071231 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 407/830] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:00.083066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f2187-b841-446c-9e15-dc69ba8b2434 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:00.090691 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16a463-5e83-4efc-89db-aeb22959b83b None admin] RBAC: Authorizing `identity:create_grant(project_id=783c362712d34405ab827e3f00a67995, user_id=51ed4c996cde4e88be26544c48200695, role_id=38bb7e6ed5854439aeaf5996eb6892f6)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:00.092519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16a463-5e83-4efc-89db-aeb22959b83b None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:00.174641 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 424/831] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 22 20:26:59 2022] PUT /identity/v3/projects/783c362712d34405ab827e3f00a67995/users/51ed4c996cde4e88be26544c48200695/roles/38bb7e6ed5854439aeaf5996eb6892f6 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:27:00.175899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16a463-5e83-4efc-89db-aeb22959b83b None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:00.209159 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f2187-b841-446c-9e15-dc69ba8b2434 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:00.260357 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32003080-d8a2-4759-b478-02edc08fe3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:00.261152 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32003080-d8a2-4759-b478-02edc08fe3cd None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:00.261433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32003080-d8a2-4759-b478-02edc08fe3cd None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:00.261708 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32003080-d8a2-4759-b478-02edc08fe3cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:00.270389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32003080-d8a2-4759-b478-02edc08fe3cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:00.272119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32003080-d8a2-4759-b478-02edc08fe3cd None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:00.285872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-32003080-d8a2-4759-b478-02edc08fe3cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:27:00.285872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:00.285872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:00.285872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:00.285872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:00.285872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:00.285872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:00.285872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:00.285872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:00.285872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:00.285872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:00.285872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:00.285872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:27:00.285872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:27:00.285872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:27:00.287075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:27:00.287075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:00.287075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:00.287075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:00.287075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:00.287075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:00.287075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:00.287075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:00.287075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:00.287075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:00.287075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:00.287075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:00.287075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:00.287075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:00.287075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:00.287075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:00.287075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:00.287958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:27:00.287958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:27:00.287958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:27:00.287958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:27:00.287958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:27:00.287958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:27:00.287958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:27:00.287958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:00.287958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 408/832] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:27:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:00.288546 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961082c-cb82-4dfd-aad9-c57839c87df9 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:00.288855 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961082c-cb82-4dfd-aad9-c57839c87df9 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:00.289130 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961082c-cb82-4dfd-aad9-c57839c87df9 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:00.294410 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 409/833] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:00.294410 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961082c-cb82-4dfd-aad9-c57839c87df9 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:00.309409 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16a463-5e83-4efc-89db-aeb22959b83b None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:00.352969 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eacb924-812d-473c-9450-5bd7063f88f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:00.353601 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eacb924-812d-473c-9450-5bd7063f88f9 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:00.353879 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eacb924-812d-473c-9450-5bd7063f88f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:00.354144 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eacb924-812d-473c-9450-5bd7063f88f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:00.367612 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eacb924-812d-473c-9450-5bd7063f88f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:27:00.370915 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:00.372418 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-2eacb924-812d-473c-9450-5bd7063f88f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:27:00.372418 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:00.372418 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:00.372418 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:00.372418 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:00.372418 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:00.372418 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:00.372418 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:00.372418 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:00.372418 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:00.372418 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:00.372418 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:00.372418 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:27:00.372418 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:27:00.372418 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:27:00.372418 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:27:00.373386 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:27:00.373386 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:27:00.373386 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:27:00.373386 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:27:00.373386 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:00.373386 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:00.373386 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:00.373386 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:00.373386 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:00.373386 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:00.373386 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:00.373386 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:00.373386 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:00.373386 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:00.373386 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:00.373386 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:00.374911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:00.374911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:00.374911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:00.374911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:00.374911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:27:00.374911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:27:00.374911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:27:00.374911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:27:00.374911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:27:00.374911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:27:00.374911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:27:00.374911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:00.374911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 425/834] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 22 20:27:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:00.374911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c25da8-1df3-4773-bfaf-b84277919912 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:00.375656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c25da8-1df3-4773-bfaf-b84277919912 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:00.375656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c25da8-1df3-4773-bfaf-b84277919912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:00.388197 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:00.395985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-a3c25da8-1df3-4773-bfaf-b84277919912 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:00.397214 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-a3c25da8-1df3-4773-bfaf-b84277919912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:00.429464 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961082c-cb82-4dfd-aad9-c57839c87df9 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:00.465936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c9549-d8b8-4f82-8aa8-ff8dbac48ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:00.466539 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c9549-d8b8-4f82-8aa8-ff8dbac48ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:00.466816 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c9549-d8b8-4f82-8aa8-ff8dbac48ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:00.467085 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c9549-d8b8-4f82-8aa8-ff8dbac48ad3 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:00.467764 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c9549-d8b8-4f82-8aa8-ff8dbac48ad3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:00.468069 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c9549-d8b8-4f82-8aa8-ff8dbac48ad3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:00.469394 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 426/835] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:27:00.469704 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c9549-d8b8-4f82-8aa8-ff8dbac48ad3 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:00.477606 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c25da8-1df3-4773-bfaf-b84277919912 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:00.488144 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 410/836] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 22 20:27:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:00.489151 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c9549-d8b8-4f82-8aa8-ff8dbac48ad3 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:00.596306 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c9549-d8b8-4f82-8aa8-ff8dbac48ad3 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:00.611354 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c25da8-1df3-4773-bfaf-b84277919912 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:00.612072 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:00.634187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e3a4b-56d3-439b-b9ee-a5df423ed21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:00.635095 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e3a4b-56d3-439b-b9ee-a5df423ed21f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:00.635787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e3a4b-56d3-439b-b9ee-a5df423ed21f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:00.636269 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e3a4b-56d3-439b-b9ee-a5df423ed21f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:00.637223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e3a4b-56d3-439b-b9ee-a5df423ed21f None admin] RBAC: Adding query filter params (role.id=e3faa0474c054da6bb4d8910a4e40bff, scope.project.id=783c362712d34405ab827e3f00a67995, user.id=9f1738f72b4848499cdf0ec6866c3c8f) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:00.650181 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e3a4b-56d3-439b-b9ee-a5df423ed21f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:00.650181 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e3a4b-56d3-439b-b9ee-a5df423ed21f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:00.650972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 411/837] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:27:00 2022] GET /identity/v3/role_assignments?user.id=9f1738f72b4848499cdf0ec6866c3c8f&scope.project.id=783c362712d34405ab827e3f00a67995&role.id=e3faa0474c054da6bb4d8910a4e40bff => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:00.655710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb50b1-f0ef-40ae-a2c7-39b1c4c2f91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:00.656420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb50b1-f0ef-40ae-a2c7-39b1c4c2f91c None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:00.657028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb50b1-f0ef-40ae-a2c7-39b1c4c2f91c None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:00.657367 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb50b1-f0ef-40ae-a2c7-39b1c4c2f91c None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:00.658226 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb50b1-f0ef-40ae-a2c7-39b1c4c2f91c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:00.658594 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb50b1-f0ef-40ae-a2c7-39b1c4c2f91c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:00.660252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb50b1-f0ef-40ae-a2c7-39b1c4c2f91c None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:00.663230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:00.671581 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 427/838] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:27:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:00.677558 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e3a4b-56d3-439b-b9ee-a5df423ed21f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:00.766662 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb50b1-f0ef-40ae-a2c7-39b1c4c2f91c None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:00.806654 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e3a4b-56d3-439b-b9ee-a5df423ed21f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:00.857557 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe10440-027e-45cb-87fe-6758c3f77c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:00.858004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe10440-027e-45cb-87fe-6758c3f77c30 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:00.858283 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe10440-027e-45cb-87fe-6758c3f77c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:00.858557 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe10440-027e-45cb-87fe-6758c3f77c30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:00.872340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe10440-027e-45cb-87fe-6758c3f77c30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:00.873971 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe10440-027e-45cb-87fe-6758c3f77c30 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:00.893108 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-fbe10440-027e-45cb-87fe-6758c3f77c30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:00.893108 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:00.893108 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:00.893108 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:00.893108 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:00.893108 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:00.893108 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:00.893108 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:00.893108 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:00.893108 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:00.893108 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:00.893108 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:00.893108 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:27:00.893108 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:27:00.893108 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:27:00.893108 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:27:00.894092 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:00.894092 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:00.894092 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:00.894092 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:00.894092 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:00.894092 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:00.894092 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:00.894092 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:00.894092 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:00.894092 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:00.894092 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:00.894092 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:00.894092 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:00.894092 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:00.894092 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:00.894092 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:00.894092 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:27:00.894988 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:27:00.894988 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:00.894988 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:00.894988 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 412/839] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:00.901338 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe10440-027e-45cb-87fe-6758c3f77c30 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:00.910203 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb50b1-f0ef-40ae-a2c7-39b1c4c2f91c None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:00.952354 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a182993-dd06-45a7-99e2-52646382cd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:00.953324 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a182993-dd06-45a7-99e2-52646382cd83 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:00.953825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a182993-dd06-45a7-99e2-52646382cd83 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:00.954253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a182993-dd06-45a7-99e2-52646382cd83 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:00.955660 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a182993-dd06-45a7-99e2-52646382cd83 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:00.957685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a182993-dd06-45a7-99e2-52646382cd83 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:00.967917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-8a182993-dd06-45a7-99e2-52646382cd83 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 20:27:00.967917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:00.967917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:27:00.967917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:27:00.967917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:27:00.967917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:27:00.967917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:27:00.967917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:27:00.967917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 20:27:00.967917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:00.967917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:27:00.967917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:00.967917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:00.967917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:00.967917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:00.967917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:00.967917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:00.969249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:00.969249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:00.969249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:00.969249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:00.969249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:00.969249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:00.969249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:27:00.969249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:27:00.969249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:27:00.969249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:27:00.969249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:00.969249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:00.969249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:00.969249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:00.969249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:00.969249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:00.970294 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:00.970294 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:00.970294 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:00.970294 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:00.970294 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:00.970294 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:00.970294 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:00.970294 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:00.970294 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:00.970294 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:00.970294 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:27:00.970294 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:27:00.970294 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 20:27:00.970294 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:00.974046 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 428/840] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 22 20:27:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:00.980717 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a182993-dd06-45a7-99e2-52646382cd83 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:01.053186 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:01.064095 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:01.106872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a182993-dd06-45a7-99e2-52646382cd83 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:01.140974 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe10440-027e-45cb-87fe-6758c3f77c30 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:01.143144 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69657d-123d-410a-80bd-599dfa8f3ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:01.143847 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69657d-123d-410a-80bd-599dfa8f3ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:01.144129 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69657d-123d-410a-80bd-599dfa8f3ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:01.144399 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69657d-123d-410a-80bd-599dfa8f3ee6 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:01.145852 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69657d-123d-410a-80bd-599dfa8f3ee6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:01.145852 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69657d-123d-410a-80bd-599dfa8f3ee6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:01.146819 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69657d-123d-410a-80bd-599dfa8f3ee6 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:01.152512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 429/841] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 22 20:27:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:01.161644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69657d-123d-410a-80bd-599dfa8f3ee6 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:01.180550 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbf992-4b52-4d88-ba27-6ab6c1e8c2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:01.181535 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbf992-4b52-4d88-ba27-6ab6c1e8c2b9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:01.182007 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbf992-4b52-4d88-ba27-6ab6c1e8c2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:01.182485 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbf992-4b52-4d88-ba27-6ab6c1e8c2b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:01.183407 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fbf992-4b52-4d88-ba27-6ab6c1e8c2b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:01.183911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fbf992-4b52-4d88-ba27-6ab6c1e8c2b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:01.185501 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fbf992-4b52-4d88-ba27-6ab6c1e8c2b9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:01.198234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 413/842] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:01.203519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbf992-4b52-4d88-ba27-6ab6c1e8c2b9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:01.272779 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69657d-123d-410a-80bd-599dfa8f3ee6 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:01.300805 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:01.306201 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:01.310269 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef5678-d180-41f9-8b1b-9ac5376e8e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:01.310835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef5678-d180-41f9-8b1b-9ac5376e8e34 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:01.313457 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef5678-d180-41f9-8b1b-9ac5376e8e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:01.313457 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef5678-d180-41f9-8b1b-9ac5376e8e34 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:01.313457 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef5678-d180-41f9-8b1b-9ac5376e8e34 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:01.313457 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef5678-d180-41f9-8b1b-9ac5376e8e34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:01.313725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef5678-d180-41f9-8b1b-9ac5376e8e34 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:01.319040 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbf992-4b52-4d88-ba27-6ab6c1e8c2b9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:01.325001 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 430/843] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 22 20:27:01 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:01.360737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a4ff0-9376-4850-a1ff-19308e4e5c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:01.361890 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a4ff0-9376-4850-a1ff-19308e4e5c13 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:01.362363 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a4ff0-9376-4850-a1ff-19308e4e5c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:01.362854 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a4ff0-9376-4850-a1ff-19308e4e5c13 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:01.372031 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a4ff0-9376-4850-a1ff-19308e4e5c13 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:01.373932 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a4ff0-9376-4850-a1ff-19308e4e5c13 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:01.387990 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-677a4ff0-9376-4850-a1ff-19308e4e5c13 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 20:27:01.387990 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:01.387990 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:01.387990 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:01.387990 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:01.387990 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:01.387990 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:01.387990 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:01.387990 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:01.387990 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:01.387990 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:01.387990 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:01.387990 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:27:01.387990 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:27:01.387990 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:27:01.387990 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:27:01.389259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:01.389259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:01.389259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:27:01.389259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:27:01.389259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:27:01.389259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:27:01.389259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:01.389259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:01.389259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:01.389259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:01.389259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:01.389259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:01.389259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:01.389259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:01.389259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:01.389259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:01.389259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:01.389259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:01.390167 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:01.390167 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:01.390167 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:27:01.390167 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:27:01.390167 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:27:01.390167 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:27:01.390167 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:27:01.390167 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:27:01.390167 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 20:27:01.390167 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:01.393575 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 414/844] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 22 20:27:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:27:01.402190 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef5678-d180-41f9-8b1b-9ac5376e8e34 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:01.513739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef5678-d180-41f9-8b1b-9ac5376e8e34 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:01.551059 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d68fa-50c7-4f86-8c75-0d70f446ae13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:01.551664 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d68fa-50c7-4f86-8c75-0d70f446ae13 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:01.551944 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d68fa-50c7-4f86-8c75-0d70f446ae13 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:01.552215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d68fa-50c7-4f86-8c75-0d70f446ae13 None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:01.552975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d68fa-50c7-4f86-8c75-0d70f446ae13 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:01.553335 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d68fa-50c7-4f86-8c75-0d70f446ae13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:01.554810 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d68fa-50c7-4f86-8c75-0d70f446ae13 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:01.574320 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 431/845] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Aug 22 20:27:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:01.581063 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a4ff0-9376-4850-a1ff-19308e4e5c13 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:01.687215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a4ff0-9376-4850-a1ff-19308e4e5c13 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:01.723346 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e2c39-a2d5-40a0-a5da-892823a884e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:01.724004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e2c39-a2d5-40a0-a5da-892823a884e5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:01.724277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e2c39-a2d5-40a0-a5da-892823a884e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:01.724601 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e2c39-a2d5-40a0-a5da-892823a884e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:01.746714 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:01.803190 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e2c39-a2d5-40a0-a5da-892823a884e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:01.808680 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e2c39-a2d5-40a0-a5da-892823a884e5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:01.906105 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 415/846] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:27:01 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 20:27:01.912297 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d68fa-50c7-4f86-8c75-0d70f446ae13 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:01.968316 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:02.023545 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d68fa-50c7-4f86-8c75-0d70f446ae13 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:02.058393 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78d946-6679-4325-a369-95e785c208de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:02.059375 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78d946-6679-4325-a369-95e785c208de None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:02.059860 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78d946-6679-4325-a369-95e785c208de None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:02.060331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78d946-6679-4325-a369-95e785c208de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:02.072946 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78d946-6679-4325-a369-95e785c208de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:02.074638 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78d946-6679-4325-a369-95e785c208de None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:02.090892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-1f78d946-6679-4325-a369-95e785c208de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:02.090892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:02.090892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:02.090892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:02.090892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:02.090892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:02.090892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:02.090892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:02.090892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:02.090892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:02.090892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:02.090892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:02.090892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:27:02.090892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:27:02.090892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:27:02.090892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:27:02.091858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:02.091858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:02.091858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:02.091858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:02.091858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:02.091858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:02.091858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:02.091858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:02.091858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:02.091858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:02.091858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:02.091858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:02.091858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:02.091858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:02.091858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:02.091858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:02.091858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:27:02.092807 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:27:02.092807 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:02.092807 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:02.094835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 432/847] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:02.100928 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e2c39-a2d5-40a0-a5da-892823a884e5 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:02.117726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c33be-4b4d-40bd-afbb-d79884f3ac52 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:02.118302 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c33be-4b4d-40bd-afbb-d79884f3ac52 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:02.118774 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c33be-4b4d-40bd-afbb-d79884f3ac52 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:02.120260 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 433/848] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:27:02.125125 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acbd11-554d-453c-bb03-592d3e18a520 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:02.125649 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acbd11-554d-453c-bb03-592d3e18a520 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:02.126117 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71acbd11-554d-453c-bb03-592d3e18a520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:02.145231 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-71acbd11-554d-453c-bb03-592d3e18a520 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:02.146725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-71acbd11-554d-453c-bb03-592d3e18a520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:02.159025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:02.216716 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e2c39-a2d5-40a0-a5da-892823a884e5 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:02.237928 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 434/849] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:27:02.259175 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb421ca-6b1d-4c12-9ad2-fa2e8fb020e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:02.260031 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb421ca-6b1d-4c12-9ad2-fa2e8fb020e1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:02.260453 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb421ca-6b1d-4c12-9ad2-fa2e8fb020e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:02.260888 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb421ca-6b1d-4c12-9ad2-fa2e8fb020e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:02.261744 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb421ca-6b1d-4c12-9ad2-fa2e8fb020e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:02.262187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb421ca-6b1d-4c12-9ad2-fa2e8fb020e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:02.263776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb421ca-6b1d-4c12-9ad2-fa2e8fb020e1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:02.280820 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 416/850] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:02.282523 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71acbd11-554d-453c-bb03-592d3e18a520 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:02.315333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:02.389254 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71acbd11-554d-453c-bb03-592d3e18a520 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:02.429481 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03de74-f069-46cd-8953-5f7f435d4e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:02.430451 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03de74-f069-46cd-8953-5f7f435d4e5a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:02.430947 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03de74-f069-46cd-8953-5f7f435d4e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:02.431428 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03de74-f069-46cd-8953-5f7f435d4e5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:02.438868 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03de74-f069-46cd-8953-5f7f435d4e5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:02.440746 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03de74-f069-46cd-8953-5f7f435d4e5a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:02.452330 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-4c03de74-f069-46cd-8953-5f7f435d4e5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:27:02.452330 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:02.452330 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:02.452330 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:02.452330 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:02.452330 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:02.452330 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:02.452330 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:02.452330 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:02.452330 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:02.452330 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:02.452330 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:02.452330 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:27:02.452330 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:27:02.452330 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:27:02.453252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:27:02.453252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:02.453252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:02.453252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:02.453252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:02.453252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:02.453252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:02.453252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:02.453252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:02.453252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:02.453252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:02.453252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:02.453252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:02.453252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:02.453252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:02.453252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:02.453252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:02.454110 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:27:02.454110 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:27:02.454110 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:27:02.454110 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:27:02.454110 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:27:02.454110 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:27:02.454110 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:27:02.454110 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:02.457120 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 435/851] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:27:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:02.465266 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb421ca-6b1d-4c12-9ad2-fa2e8fb020e1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:02.509542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03de74-f069-46cd-8953-5f7f435d4e5a None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:02.575773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb421ca-6b1d-4c12-9ad2-fa2e8fb020e1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:02.592013 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:02.616310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:02.621348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f7a63-90b2-4046-b8b9-4ee2ec52172b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:02.622414 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f7a63-90b2-4046-b8b9-4ee2ec52172b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:02.623063 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f7a63-90b2-4046-b8b9-4ee2ec52172b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:02.623526 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f7a63-90b2-4046-b8b9-4ee2ec52172b None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:02.624352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f7a63-90b2-4046-b8b9-4ee2ec52172b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:02.624820 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f7a63-90b2-4046-b8b9-4ee2ec52172b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:02.625976 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03de74-f069-46cd-8953-5f7f435d4e5a None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:02.627353 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f7a63-90b2-4046-b8b9-4ee2ec52172b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:02.645841 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 417/852] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 22 20:27:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:02.646960 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f7a63-90b2-4046-b8b9-4ee2ec52172b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:02.662393 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d579ec7-2ee0-4514-8574-e55c41ffe84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:02.663027 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d579ec7-2ee0-4514-8574-e55c41ffe84e None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:02.663327 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d579ec7-2ee0-4514-8574-e55c41ffe84e None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:02.663592 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d579ec7-2ee0-4514-8574-e55c41ffe84e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:02.674654 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d579ec7-2ee0-4514-8574-e55c41ffe84e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:27:02.680331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-8d579ec7-2ee0-4514-8574-e55c41ffe84e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:27:02.680331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:02.680331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:02.680331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:02.680331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:02.680331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:02.680331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:02.680331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:02.680331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:02.680331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:02.680331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:02.680331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:02.680331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:27:02.680331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:27:02.680331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:27:02.680331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:27:02.681494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:27:02.681494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:27:02.681494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:27:02.681494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:27:02.681494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:02.681494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:02.681494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:02.681494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:02.681494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:02.681494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:02.681494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:02.681494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:02.681494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:02.681494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:02.681494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:02.681494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:02.682537 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:02.682537 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:02.682537 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:02.682537 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:02.682537 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:27:02.682537 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:27:02.682537 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:27:02.682537 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:27:02.682537 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:27:02.682537 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:27:02.682537 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:27:02.682537 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:02.685261 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 436/853] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 22 20:27:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:27:02.700681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d579ec7-2ee0-4514-8574-e55c41ffe84e None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:02.761254 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f7a63-90b2-4046-b8b9-4ee2ec52172b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:02.802917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef1a08-b0df-4b9d-a48e-713a435c19cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:02.802917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef1a08-b0df-4b9d-a48e-713a435c19cc None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:02.802917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef1a08-b0df-4b9d-a48e-713a435c19cc None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:02.802917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef1a08-b0df-4b9d-a48e-713a435c19cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:02.803493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef1a08-b0df-4b9d-a48e-713a435c19cc None admin] RBAC: Adding query filter params (role.id=e3faa0474c054da6bb4d8910a4e40bff, scope.project.id=783c362712d34405ab827e3f00a67995, user.id=907607fd209b416ba9b68512772c1d17) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:02.803804 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef1a08-b0df-4b9d-a48e-713a435c19cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:02.805267 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef1a08-b0df-4b9d-a48e-713a435c19cc None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:02.811886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 418/854] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:27:02 2022] GET /identity/v3/role_assignments?user.id=907607fd209b416ba9b68512772c1d17&scope.project.id=783c362712d34405ab827e3f00a67995&role.id=e3faa0474c054da6bb4d8910a4e40bff => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:02.816689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a75328-c535-4bcb-9c3f-7b4bb65f7a71 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:02.816689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a75328-c535-4bcb-9c3f-7b4bb65f7a71 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:02.816689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a75328-c535-4bcb-9c3f-7b4bb65f7a71 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:02.816689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 419/855] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:02.820874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7074ca-0e05-473b-85dd-ca4f68eee324 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:02.821101 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7074ca-0e05-473b-85dd-ca4f68eee324 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:02.821385 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7074ca-0e05-473b-85dd-ca4f68eee324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:02.823034 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d579ec7-2ee0-4514-8574-e55c41ffe84e None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:02.841518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-da7074ca-0e05-473b-85dd-ca4f68eee324 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:02.842602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-da7074ca-0e05-473b-85dd-ca4f68eee324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:02.864572 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b272d28-672e-4af6-99cf-f78ca29cdd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:02.865222 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b272d28-672e-4af6-99cf-f78ca29cdd27 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:02.865500 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b272d28-672e-4af6-99cf-f78ca29cdd27 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:02.865773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b272d28-672e-4af6-99cf-f78ca29cdd27 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:02.866513 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b272d28-672e-4af6-99cf-f78ca29cdd27 None admin] RBAC: Adding query filter params (name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:02.866815 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b272d28-672e-4af6-99cf-f78ca29cdd27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:02.868267 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b272d28-672e-4af6-99cf-f78ca29cdd27 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:02.882028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:02.882752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 437/856] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 22 20:27:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:02.883802 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b272d28-672e-4af6-99cf-f78ca29cdd27 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:02.903007 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:02.929789 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 420/857] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:02 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:27:03.005200 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b272d28-672e-4af6-99cf-f78ca29cdd27 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:03.042161 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc116f49-31a9-4a50-a12b-b6cdf6e3e921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:03.042793 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc116f49-31a9-4a50-a12b-b6cdf6e3e921 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:03.043070 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc116f49-31a9-4a50-a12b-b6cdf6e3e921 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:03.043340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc116f49-31a9-4a50-a12b-b6cdf6e3e921 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:03.054322 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc116f49-31a9-4a50-a12b-b6cdf6e3e921 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:03.055785 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc116f49-31a9-4a50-a12b-b6cdf6e3e921 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:03.071975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-dc116f49-31a9-4a50-a12b-b6cdf6e3e921 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:03.071975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:03.071975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:03.071975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:03.071975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:03.071975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:03.071975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:03.071975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:03.071975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:03.071975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:03.071975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:03.071975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:03.071975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:27:03.071975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:27:03.071975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:27:03.071975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:27:03.073096 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:03.073096 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:03.073096 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:03.073096 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:03.073096 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:03.073096 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:03.073096 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:03.073096 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:03.073096 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:03.073096 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:03.073096 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:03.073096 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:03.073096 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:03.073096 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:03.073096 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:03.073096 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:03.073096 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:27:03.074021 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:27:03.074021 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:03.074021 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:03.074021 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 438/858] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:03.079405 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7074ca-0e05-473b-85dd-ca4f68eee324 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:03.184695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7074ca-0e05-473b-85dd-ca4f68eee324 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:03.214938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc116f49-31a9-4a50-a12b-b6cdf6e3e921 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:03.231375 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f9d94-93a8-4a60-809e-bd1b2d52d50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:03.232542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f9d94-93a8-4a60-809e-bd1b2d52d50a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:03.233049 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f9d94-93a8-4a60-809e-bd1b2d52d50a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:03.233546 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f9d94-93a8-4a60-809e-bd1b2d52d50a None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:03.234392 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f9d94-93a8-4a60-809e-bd1b2d52d50a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:03.234893 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f9d94-93a8-4a60-809e-bd1b2d52d50a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:03.237390 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f9d94-93a8-4a60-809e-bd1b2d52d50a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:03.250086 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 421/859] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:03.258788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f9d94-93a8-4a60-809e-bd1b2d52d50a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:03.291288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:03.291819 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:03.343840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc116f49-31a9-4a50-a12b-b6cdf6e3e921 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:03.382227 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099644ef-7a22-4abb-b540-23f8255afd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:03.382925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099644ef-7a22-4abb-b540-23f8255afd99 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:03.383209 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099644ef-7a22-4abb-b540-23f8255afd99 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:03.383487 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099644ef-7a22-4abb-b540-23f8255afd99 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:03.384074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099644ef-7a22-4abb-b540-23f8255afd99 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:03.385559 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099644ef-7a22-4abb-b540-23f8255afd99 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:03.395349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-099644ef-7a22-4abb-b540-23f8255afd99 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 20:27:03.395349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:03.395349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:27:03.395349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:27:03.395349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:27:03.395349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:27:03.395349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:27:03.395349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:27:03.395349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 20:27:03.395349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:03.395349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:27:03.395349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:03.395349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:03.395349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:03.395349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:03.395349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:03.396284 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:03.396284 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:03.396284 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:03.396284 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:03.396284 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:03.396284 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:03.396284 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:03.396284 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:27:03.396284 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:27:03.396284 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:27:03.396284 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:27:03.396284 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:03.396284 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:03.396284 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:03.396284 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:03.396284 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:03.396284 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:03.397539 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:03.397539 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:03.397539 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:03.397539 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:03.397539 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:03.397539 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:03.397539 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:03.397539 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:03.397539 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:03.397539 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:03.397539 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:27:03.397539 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:27:03.397539 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 20:27:03.397539 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:03.398640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f9d94-93a8-4a60-809e-bd1b2d52d50a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:03.401479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 439/860] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Aug 22 20:27:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:27:03.402846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928bf2d-2356-4f84-bcb3-da6424bf6a85 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:03.403197 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928bf2d-2356-4f84-bcb3-da6424bf6a85 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:03.403516 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928bf2d-2356-4f84-bcb3-da6424bf6a85 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:03.409081 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 440/861] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:03.409081 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928bf2d-2356-4f84-bcb3-da6424bf6a85 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:03.442291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32dbf93-61b5-4151-a2c3-b6378b9a1259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:03.442932 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32dbf93-61b5-4151-a2c3-b6378b9a1259 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:03.443212 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32dbf93-61b5-4151-a2c3-b6378b9a1259 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:03.443477 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32dbf93-61b5-4151-a2c3-b6378b9a1259 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:03.454176 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32dbf93-61b5-4151-a2c3-b6378b9a1259 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:03.456417 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32dbf93-61b5-4151-a2c3-b6378b9a1259 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:03.471953 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-d32dbf93-61b5-4151-a2c3-b6378b9a1259 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 20:27:03.471953 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:03.471953 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:03.471953 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:03.471953 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:03.471953 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:03.471953 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:03.471953 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:03.471953 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:03.471953 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:03.471953 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:03.471953 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:03.471953 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:27:03.471953 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:27:03.471953 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:27:03.471953 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:27:03.472979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:03.472979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:03.472979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:27:03.472979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:27:03.472979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:27:03.472979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:27:03.472979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:03.472979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:03.472979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:03.472979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:03.472979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:03.472979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:03.472979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:03.472979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:03.472979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:03.472979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:03.472979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:03.472979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:03.474047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:03.474047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:03.474047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:27:03.474047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:27:03.474047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:27:03.474047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:27:03.474047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:27:03.474047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:27:03.474047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 20:27:03.474047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:03.475073 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 422/862] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Aug 22 20:27:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:03.476272 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64cb4cb-6759-40e0-8d70-3b19ee1a231f None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:03.476553 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64cb4cb-6759-40e0-8d70-3b19ee1a231f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:03.477178 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64cb4cb-6759-40e0-8d70-3b19ee1a231f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:03.495833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-a64cb4cb-6759-40e0-8d70-3b19ee1a231f None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:03.497051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a64cb4cb-6759-40e0-8d70-3b19ee1a231f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:03.524820 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928bf2d-2356-4f84-bcb3-da6424bf6a85 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:03.555539 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:03.564531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7c395-f401-4fcc-acd8-f7145ba716a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:03.565178 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7c395-f401-4fcc-acd8-f7145ba716a5 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:03.565461 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7c395-f401-4fcc-acd8-f7145ba716a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:03.565802 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7c395-f401-4fcc-acd8-f7145ba716a5 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:03.566370 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7c395-f401-4fcc-acd8-f7145ba716a5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:03.566673 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7c395-f401-4fcc-acd8-f7145ba716a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:03.568235 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7c395-f401-4fcc-acd8-f7145ba716a5 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:03.572930 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 423/863] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:03 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:27:03.572930 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64cb4cb-6759-40e0-8d70-3b19ee1a231f None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:03.580903 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 441/864] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Aug 22 20:27:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:03.581980 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7c395-f401-4fcc-acd8-f7145ba716a5 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:03.593128 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:03.709531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64cb4cb-6759-40e0-8d70-3b19ee1a231f None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:03.721768 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7c395-f401-4fcc-acd8-f7145ba716a5 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:03.746130 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99322280-a192-428f-b8ff-6086ab95b886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:03.746734 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99322280-a192-428f-b8ff-6086ab95b886 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:03.747008 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99322280-a192-428f-b8ff-6086ab95b886 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:03.747280 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99322280-a192-428f-b8ff-6086ab95b886 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:03.748133 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99322280-a192-428f-b8ff-6086ab95b886 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:03.748492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99322280-a192-428f-b8ff-6086ab95b886 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:03.750013 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99322280-a192-428f-b8ff-6086ab95b886 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:03.768609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997f437-1868-4e56-8c86-099533c6d7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:03.773631 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 424/865] 10.222.0.62 () {56 vars in 1149 bytes} [Mon Aug 22 20:27:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:03.773770 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997f437-1868-4e56-8c86-099533c6d7df None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:03.773770 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997f437-1868-4e56-8c86-099533c6d7df None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:03.774481 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99322280-a192-428f-b8ff-6086ab95b886 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:03.775087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997f437-1868-4e56-8c86-099533c6d7df None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:03.775674 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997f437-1868-4e56-8c86-099533c6d7df None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:03.775978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997f437-1868-4e56-8c86-099533c6d7df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:03.777402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997f437-1868-4e56-8c86-099533c6d7df None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:03.794684 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 442/866] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Aug 22 20:27:03 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:03.850826 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997f437-1868-4e56-8c86-099533c6d7df None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:03.869547 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:03.917073 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99322280-a192-428f-b8ff-6086ab95b886 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:03.923103 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:03.963537 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c297f-91f4-4a33-af9d-d167c5fbfbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:03.964434 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c297f-91f4-4a33-af9d-d167c5fbfbe4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:03.965430 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c297f-91f4-4a33-af9d-d167c5fbfbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:03.965430 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c297f-91f4-4a33-af9d-d167c5fbfbe4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:03.978127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997f437-1868-4e56-8c86-099533c6d7df None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:04.014958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f390ab7-34c3-4ec4-b63c-6094f09d898e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:04.015730 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f390ab7-34c3-4ec4-b63c-6094f09d898e None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:04.016108 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f390ab7-34c3-4ec4-b63c-6094f09d898e None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:04.016477 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f390ab7-34c3-4ec4-b63c-6094f09d898e None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:04.019786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f390ab7-34c3-4ec4-b63c-6094f09d898e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:04.021774 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f390ab7-34c3-4ec4-b63c-6094f09d898e None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:04.044380 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1c297f-91f4-4a33-af9d-d167c5fbfbe4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:04.044380 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1c297f-91f4-4a33-af9d-d167c5fbfbe4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:04.102553 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 443/867] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Aug 22 20:27:03 2022] POST /identity/v3/services => generated 251 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:27:04.129587 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:04.171317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 425/868] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:27:03 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 20:27:04.174024 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f390ab7-34c3-4ec4-b63c-6094f09d898e None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:04.294941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f390ab7-34c3-4ec4-b63c-6094f09d898e None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:04.309857 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:04.332804 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c78c72-d8f6-4c90-b995-036db053c823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:04.333441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c78c72-d8f6-4c90-b995-036db053c823 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:04.333955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c78c72-d8f6-4c90-b995-036db053c823 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:04.334234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c78c72-d8f6-4c90-b995-036db053c823 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:04.346616 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c78c72-d8f6-4c90-b995-036db053c823 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:04.348271 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c78c72-d8f6-4c90-b995-036db053c823 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:04.363877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-73c78c72-d8f6-4c90-b995-036db053c823 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:04.363877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:04.363877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:04.363877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:04.363877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:04.363877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:04.363877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:04.363877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:04.363877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:04.363877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:04.363877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:04.363877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:04.363877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:27:04.363877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:27:04.363877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:27:04.363877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:27:04.364906 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:04.364906 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:04.364906 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:04.364906 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:04.364906 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:04.364906 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:04.364906 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:04.364906 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:04.364906 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:04.364906 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:04.364906 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:04.364906 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:04.364906 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:04.364906 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:04.364906 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:04.364906 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:04.364906 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:27:04.365812 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:27:04.365812 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:04.365812 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:04.365812 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 444/869] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:04.371775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c297f-91f4-4a33-af9d-d167c5fbfbe4 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:04.480784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c297f-91f4-4a33-af9d-d167c5fbfbe4 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:04.517646 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abdff6-24bc-4d9c-9946-454575a87f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:04.518303 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abdff6-24bc-4d9c-9946-454575a87f45 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:04.518586 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abdff6-24bc-4d9c-9946-454575a87f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:04.518858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abdff6-24bc-4d9c-9946-454575a87f45 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:04.519500 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6abdff6-24bc-4d9c-9946-454575a87f45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:04.519800 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6abdff6-24bc-4d9c-9946-454575a87f45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:04.521243 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6abdff6-24bc-4d9c-9946-454575a87f45 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:04.533719 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 426/870] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:04.539082 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c78c72-d8f6-4c90-b995-036db053c823 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:04.644878 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c78c72-d8f6-4c90-b995-036db053c823 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:04.692735 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4217713-a5fe-40f5-af64-ca8d0a95366d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:04.693366 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4217713-a5fe-40f5-af64-ca8d0a95366d None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:04.693644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4217713-a5fe-40f5-af64-ca8d0a95366d None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:04.693912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4217713-a5fe-40f5-af64-ca8d0a95366d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:04.701119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4217713-a5fe-40f5-af64-ca8d0a95366d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:04.702561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4217713-a5fe-40f5-af64-ca8d0a95366d None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:04.714877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-d4217713-a5fe-40f5-af64-ca8d0a95366d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:27:04.714877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:04.714877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:04.714877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:04.714877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:04.714877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:04.714877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:04.714877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:04.714877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:04.714877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:04.714877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:04.714877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:04.714877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:27:04.714877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:27:04.714877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:27:04.716920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:27:04.716920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:04.716920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:04.716920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:04.716920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:04.716920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:04.716920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:04.716920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:04.716920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:04.716920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:04.716920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:04.716920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:04.716920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:04.716920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:04.716920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:04.716920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:04.716920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:04.719068 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:27:04.719068 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:27:04.719068 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:27:04.719068 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:27:04.719068 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:27:04.719068 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:27:04.719068 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:27:04.719068 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:04.724677 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 445/871] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:27:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:04.724884 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abdff6-24bc-4d9c-9946-454575a87f45 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:04.755446 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:04.829154 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abdff6-24bc-4d9c-9946-454575a87f45 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:04.870159 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77aba8b-cc5e-4ea1-acc8-c393402e206b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:04.870771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77aba8b-cc5e-4ea1-acc8-c393402e206b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:04.871051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77aba8b-cc5e-4ea1-acc8-c393402e206b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:04.871325 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77aba8b-cc5e-4ea1-acc8-c393402e206b None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:04.872016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77aba8b-cc5e-4ea1-acc8-c393402e206b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:04.872321 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77aba8b-cc5e-4ea1-acc8-c393402e206b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:04.873783 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77aba8b-cc5e-4ea1-acc8-c393402e206b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:04.886869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 427/872] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 22 20:27:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:04.893692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4217713-a5fe-40f5-af64-ca8d0a95366d None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:04.922967 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:04.954818 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac4c26-bb41-43c8-a9e5-96402c3fa439 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:04.955146 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac4c26-bb41-43c8-a9e5-96402c3fa439 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:04.955374 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac4c26-bb41-43c8-a9e5-96402c3fa439 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:04.957116 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 428/873] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:27:04.962259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c8d49-9d15-4ac9-ae19-6454391ede9a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:04.962540 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c8d49-9d15-4ac9-ae19-6454391ede9a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:04.962808 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c8d49-9d15-4ac9-ae19-6454391ede9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:04.988813 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-898c8d49-9d15-4ac9-ae19-6454391ede9a None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:04.990301 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-898c8d49-9d15-4ac9-ae19-6454391ede9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:05.019851 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4217713-a5fe-40f5-af64-ca8d0a95366d None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:05.066560 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124bda4-13ec-4841-ba33-7b4ee48fc9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:05.067155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124bda4-13ec-4841-ba33-7b4ee48fc9f3 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:05.067430 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124bda4-13ec-4841-ba33-7b4ee48fc9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:05.067699 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124bda4-13ec-4841-ba33-7b4ee48fc9f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:05.068412 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6124bda4-13ec-4841-ba33-7b4ee48fc9f3 None admin] RBAC: Adding query filter params (role.id=38bb7e6ed5854439aeaf5996eb6892f6, scope.project.id=783c362712d34405ab827e3f00a67995, user.id=51ed4c996cde4e88be26544c48200695) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:05.068755 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6124bda4-13ec-4841-ba33-7b4ee48fc9f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:05.070162 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6124bda4-13ec-4841-ba33-7b4ee48fc9f3 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:05.070607 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 429/874] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:04 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:27:05.084413 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 446/875] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:27:04 2022] GET /identity/v3/role_assignments?user.id=51ed4c996cde4e88be26544c48200695&scope.project.id=783c362712d34405ab827e3f00a67995&role.id=38bb7e6ed5854439aeaf5996eb6892f6 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:05.353906 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c8d49-9d15-4ac9-ae19-6454391ede9a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:05.382254 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:05.462050 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c8d49-9d15-4ac9-ae19-6454391ede9a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:05.513537 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce795773-2ce8-499f-b15b-10bccea8cf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:05.514198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce795773-2ce8-499f-b15b-10bccea8cf0a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:05.514471 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce795773-2ce8-499f-b15b-10bccea8cf0a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:05.514816 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce795773-2ce8-499f-b15b-10bccea8cf0a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:05.515323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce795773-2ce8-499f-b15b-10bccea8cf0a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:05.518085 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce795773-2ce8-499f-b15b-10bccea8cf0a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:05.535242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-ce795773-2ce8-499f-b15b-10bccea8cf0a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 20:27:05.535242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:05.535242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:27:05.535242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:27:05.535242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:27:05.535242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:27:05.535242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:27:05.535242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:27:05.535242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 20:27:05.535242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:05.535242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:27:05.535242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:05.535242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:05.535242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:05.535242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:05.535242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:05.535242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:05.536276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:05.536276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:05.536276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:05.536276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:05.536276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:05.536276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:05.536276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:27:05.536276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:27:05.536276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:27:05.536276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:27:05.536276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:05.536276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:05.536276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:05.536276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:05.536276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:05.536276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:05.537135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:05.537135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:05.537135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:05.537135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:05.537135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:05.537135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:05.537135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:05.537135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:05.537135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:05.537135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:05.537135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:27:05.537135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:27:05.537135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 20:27:05.537135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:05.539310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 430/876] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Aug 22 20:27:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:27:05.545526 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124bda4-13ec-4841-ba33-7b4ee48fc9f3 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:05.649846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124bda4-13ec-4841-ba33-7b4ee48fc9f3 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:05.652408 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:05.685747 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20095e2-b9f0-46f1-9edf-fdf2d7419ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:05.686271 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20095e2-b9f0-46f1-9edf-fdf2d7419ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:05.686551 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20095e2-b9f0-46f1-9edf-fdf2d7419ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:05.686822 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20095e2-b9f0-46f1-9edf-fdf2d7419ed3 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:05.687449 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20095e2-b9f0-46f1-9edf-fdf2d7419ed3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:05.687750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20095e2-b9f0-46f1-9edf-fdf2d7419ed3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:05.689944 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20095e2-b9f0-46f1-9edf-fdf2d7419ed3 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:05.695126 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 447/877] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Aug 22 20:27:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:05.701002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce795773-2ce8-499f-b15b-10bccea8cf0a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:05.766402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b3014-41df-41a8-b343-a6fd19057a1c None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:05.766791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b3014-41df-41a8-b343-a6fd19057a1c None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:05.767008 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b3014-41df-41a8-b343-a6fd19057a1c None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:05.768407 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 448/878] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:27:05.773997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fb28b-7b0b-49a0-a67b-9301d7eb3a9a None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:05.774287 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fb28b-7b0b-49a0-a67b-9301d7eb3a9a None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:05.774560 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fb28b-7b0b-49a0-a67b-9301d7eb3a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:05.801043 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:05.807530 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-d42fb28b-7b0b-49a0-a67b-9301d7eb3a9a None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:05.809249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-d42fb28b-7b0b-49a0-a67b-9301d7eb3a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:05.817517 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce795773-2ce8-499f-b15b-10bccea8cf0a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:05.852940 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237575a2-993b-4451-a998-0ffbfa56d9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:05.854119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237575a2-993b-4451-a998-0ffbfa56d9b2 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:05.854621 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237575a2-993b-4451-a998-0ffbfa56d9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:05.855091 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237575a2-993b-4451-a998-0ffbfa56d9b2 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:05.856009 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237575a2-993b-4451-a998-0ffbfa56d9b2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:05.856535 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237575a2-993b-4451-a998-0ffbfa56d9b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:05.858451 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237575a2-993b-4451-a998-0ffbfa56d9b2 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:05.864386 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 431/879] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Aug 22 20:27:05 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:05.898519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 449/880] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:05 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:27:06.170444 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237575a2-993b-4451-a998-0ffbfa56d9b2 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:06.240531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b732593-a9bd-46db-95c0-46fa0cca86bf None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:06.240877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b732593-a9bd-46db-95c0-46fa0cca86bf None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:06.241131 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b732593-a9bd-46db-95c0-46fa0cca86bf None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:06.242716 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 450/881] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:27:06.247613 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c93b1-c709-409b-890d-c94d8b4fc28b None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:06.247901 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c93b1-c709-409b-890d-c94d8b4fc28b None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:06.248182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c93b1-c709-409b-890d-c94d8b4fc28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:06.266524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-de7c93b1-c709-409b-890d-c94d8b4fc28b None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:06.267772 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-de7c93b1-c709-409b-890d-c94d8b4fc28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:06.281047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237575a2-993b-4451-a998-0ffbfa56d9b2 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:06.335063 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44180f07-1e2c-4cf7-9da1-5a5ffba17d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:06.335672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44180f07-1e2c-4cf7-9da1-5a5ffba17d8a None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:06.335957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44180f07-1e2c-4cf7-9da1-5a5ffba17d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:06.336220 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44180f07-1e2c-4cf7-9da1-5a5ffba17d8a None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:06.336918 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44180f07-1e2c-4cf7-9da1-5a5ffba17d8a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:06.338362 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44180f07-1e2c-4cf7-9da1-5a5ffba17d8a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:06.348609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 451/882] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:06 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:27:06.451875 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 432/883] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Aug 22 20:27:06 2022] POST /identity/v3/services => generated 269 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:27:06.627114 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c93b1-c709-409b-890d-c94d8b4fc28b None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:06.644932 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:06.739515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c93b1-c709-409b-890d-c94d8b4fc28b None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:06.783347 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e07ae1-e447-4afd-b6ad-decadc0d7062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:06.784275 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e07ae1-e447-4afd-b6ad-decadc0d7062 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:06.784743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e07ae1-e447-4afd-b6ad-decadc0d7062 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:06.785160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e07ae1-e447-4afd-b6ad-decadc0d7062 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:06.785963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e07ae1-e447-4afd-b6ad-decadc0d7062 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:06.787531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e07ae1-e447-4afd-b6ad-decadc0d7062 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:06.797276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-45e07ae1-e447-4afd-b6ad-decadc0d7062 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 20:27:06.797276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:06.797276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:27:06.797276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:27:06.797276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:27:06.797276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:27:06.797276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:27:06.797276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:27:06.797276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 20:27:06.797276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:06.797276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:27:06.797276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:06.797276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:06.797276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:06.797276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:06.797276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:06.797276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:06.798317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:06.798317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:06.798317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:06.798317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:06.798317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:06.798317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:06.798317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:27:06.798317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:27:06.798317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:27:06.798317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:27:06.798317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:06.798317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:06.798317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:06.798317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:06.798317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:06.798317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:06.799173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:06.799173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:06.799173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:06.799173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:06.799173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:06.799173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:06.799173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:06.799173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:06.799173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:06.799173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:06.799173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:27:06.799173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:27:06.799173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 20:27:06.799173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:06.799173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 452/884] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 22 20:27:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:06.804954 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44180f07-1e2c-4cf7-9da1-5a5ffba17d8a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:06.825301 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:06.913402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44180f07-1e2c-4cf7-9da1-5a5ffba17d8a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:06.952937 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319b632-6e85-4e69-92bf-2a347e1f0a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:06.954000 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319b632-6e85-4e69-92bf-2a347e1f0a84 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:06.955103 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319b632-6e85-4e69-92bf-2a347e1f0a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:06.955583 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319b632-6e85-4e69-92bf-2a347e1f0a84 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:06.956423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319b632-6e85-4e69-92bf-2a347e1f0a84 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:06.956968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319b632-6e85-4e69-92bf-2a347e1f0a84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:06.958562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319b632-6e85-4e69-92bf-2a347e1f0a84 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:06.963789 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 433/885] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 22 20:27:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:06.969512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e07ae1-e447-4afd-b6ad-decadc0d7062 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:07.051016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:07.082852 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e07ae1-e447-4afd-b6ad-decadc0d7062 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:07.117344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6fdd0-7de4-4e40-828a-b734634e5c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:07.117950 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6fdd0-7de4-4e40-828a-b734634e5c73 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:07.118228 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6fdd0-7de4-4e40-828a-b734634e5c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:07.118500 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6fdd0-7de4-4e40-828a-b734634e5c73 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:07.119128 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6fdd0-7de4-4e40-828a-b734634e5c73 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:07.119430 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6fdd0-7de4-4e40-828a-b734634e5c73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:07.120837 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6fdd0-7de4-4e40-828a-b734634e5c73 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:07.126881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 453/886] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 22 20:27:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:07.132941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319b632-6e85-4e69-92bf-2a347e1f0a84 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:07.160388 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610a289-c794-4749-ab6a-6df63b4446e3 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:07.160388 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610a289-c794-4749-ab6a-6df63b4446e3 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:07.160690 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610a289-c794-4749-ab6a-6df63b4446e3 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:07.162488 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 454/887] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:27:07.167703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d836a-59f7-4164-bdb4-313689b3694d None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:07.167909 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d836a-59f7-4164-bdb4-313689b3694d None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:07.168165 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d836a-59f7-4164-bdb4-313689b3694d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:07.189782 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-ea2d836a-59f7-4164-bdb4-313689b3694d None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:07.191050 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-ea2d836a-59f7-4164-bdb4-313689b3694d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:07.227838 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:07.243621 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319b632-6e85-4e69-92bf-2a347e1f0a84 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:07.270501 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 455/888] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:07 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:27:07.284857 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175bc2d-e754-466e-a109-7505c2d74e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:07.285677 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175bc2d-e754-466e-a109-7505c2d74e3a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:07.286107 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175bc2d-e754-466e-a109-7505c2d74e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:07.286536 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175bc2d-e754-466e-a109-7505c2d74e3a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:07.287383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d175bc2d-e754-466e-a109-7505c2d74e3a None admin] RBAC: Adding query filter params (interface=public, service_id=86e3d9efb817429ca2d39b429f1dc8ec, region_id=RegionOne) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:07.287928 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d175bc2d-e754-466e-a109-7505c2d74e3a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:07.289531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d175bc2d-e754-466e-a109-7505c2d74e3a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:07.297516 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 434/889] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Aug 22 20:27:07 2022] GET /identity/v3/endpoints?service_id=86e3d9efb817429ca2d39b429f1dc8ec&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:07.303931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d836a-59f7-4164-bdb4-313689b3694d None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:07.376699 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:07.421086 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d836a-59f7-4164-bdb4-313689b3694d None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:07.458620 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7183cfc-40cf-4497-ac96-423e52b7fb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:07.459229 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7183cfc-40cf-4497-ac96-423e52b7fb8a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:07.459506 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7183cfc-40cf-4497-ac96-423e52b7fb8a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:07.459778 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7183cfc-40cf-4497-ac96-423e52b7fb8a None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:07.460379 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7183cfc-40cf-4497-ac96-423e52b7fb8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:07.461774 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7183cfc-40cf-4497-ac96-423e52b7fb8a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:07.467886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 456/890] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Aug 22 20:27:07 2022] GET /identity/v3/services => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:27:07.550077 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175bc2d-e754-466e-a109-7505c2d74e3a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:07.673560 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175bc2d-e754-466e-a109-7505c2d74e3a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:07.710493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026d91e-c1ba-43aa-b692-ad93696a822f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:07.711129 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026d91e-c1ba-43aa-b692-ad93696a822f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:07.711410 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026d91e-c1ba-43aa-b692-ad93696a822f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:07.711683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026d91e-c1ba-43aa-b692-ad93696a822f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:07.718677 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:07.723990 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026d91e-c1ba-43aa-b692-ad93696a822f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:27:07.728669 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-2026d91e-c1ba-43aa-b692-ad93696a822f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 20:27:07.728669 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:07.728669 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:07.728669 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:07.728669 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:07.728669 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:07.728669 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:07.728669 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:07.728669 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:07.728669 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:07.728669 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:07.728669 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:07.728669 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:27:07.728669 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:27:07.728669 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:27:07.728669 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:27:07.729584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:27:07.729584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:27:07.729584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:27:07.729584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:27:07.729584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:07.729584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:07.729584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:07.729584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:07.729584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:07.729584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:07.729584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:07.729584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:07.729584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:07.729584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:07.729584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:07.729584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:07.730458 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:07.730458 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:07.730458 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:07.730458 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:07.730458 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:27:07.730458 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:27:07.730458 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:27:07.730458 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:27:07.730458 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:27:07.730458 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:27:07.730458 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 20:27:07.730458 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:07.730458 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 435/891] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Aug 22 20:27:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:07.736512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7183cfc-40cf-4497-ac96-423e52b7fb8a None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:07.840646 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a13dd-ee84-4b8c-9c47-2c214db5f5da None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:07.841189 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a13dd-ee84-4b8c-9c47-2c214db5f5da None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:07.841189 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a13dd-ee84-4b8c-9c47-2c214db5f5da None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:07.842790 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 436/892] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:07.848473 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e160b24-222b-4d44-88e9-231afe98eb78 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:07.848793 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e160b24-222b-4d44-88e9-231afe98eb78 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:07.849071 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e160b24-222b-4d44-88e9-231afe98eb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:07.860305 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7183cfc-40cf-4497-ac96-423e52b7fb8a None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:07.870813 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-9e160b24-222b-4d44-88e9-231afe98eb78 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:07.872337 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9e160b24-222b-4d44-88e9-231afe98eb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:07.890944 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:07.898472 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13aeff-be0c-4023-aad5-e7d62ef2d278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:07.899080 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13aeff-be0c-4023-aad5-e7d62ef2d278 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:07.899360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13aeff-be0c-4023-aad5-e7d62ef2d278 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:07.900176 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13aeff-be0c-4023-aad5-e7d62ef2d278 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:07.900886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee13aeff-be0c-4023-aad5-e7d62ef2d278 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:07.908626 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee13aeff-be0c-4023-aad5-e7d62ef2d278 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:07.908626 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee13aeff-be0c-4023-aad5-e7d62ef2d278 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:07.915511 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 457/893] 10.222.0.62 () {56 vars in 1115 bytes} [Mon Aug 22 20:27:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:07.920891 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13aeff-be0c-4023-aad5-e7d62ef2d278 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:07.960272 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 437/894] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:07 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:27:08.042058 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13aeff-be0c-4023-aad5-e7d62ef2d278 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:08.083927 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0697d-5b47-44e8-88a4-04a2102bf0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:08.084616 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0697d-5b47-44e8-88a4-04a2102bf0bf None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:08.084931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0697d-5b47-44e8-88a4-04a2102bf0bf None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:08.085205 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0697d-5b47-44e8-88a4-04a2102bf0bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:08.096216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0697d-5b47-44e8-88a4-04a2102bf0bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:08.097777 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0697d-5b47-44e8-88a4-04a2102bf0bf None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:08.113509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-64b0697d-5b47-44e8-88a4-04a2102bf0bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:08.113509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:08.113509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:08.113509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:08.113509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:08.113509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:08.113509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:08.113509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:08.113509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:08.113509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:08.113509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:08.113509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:08.113509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:27:08.113509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:27:08.113509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:27:08.113509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:27:08.115702 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:08.115702 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:08.115702 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:08.115702 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:08.115702 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:08.115702 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:08.115702 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:08.115702 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:08.115702 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:08.115702 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:08.115702 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:08.115702 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:08.115702 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:08.115702 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:08.115702 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:08.115702 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:08.115702 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:27:08.117844 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:27:08.117844 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:08.117844 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:08.117844 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 458/895] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:08.120511 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e160b24-222b-4d44-88e9-231afe98eb78 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:08.225671 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e160b24-222b-4d44-88e9-231afe98eb78 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:08.256307 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:08.261583 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0697d-5b47-44e8-88a4-04a2102bf0bf None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:08.267556 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec81868-6f96-4ea9-91af-34d0badc9780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:08.268408 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec81868-6f96-4ea9-91af-34d0badc9780 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:08.268887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec81868-6f96-4ea9-91af-34d0badc9780 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:08.269326 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec81868-6f96-4ea9-91af-34d0badc9780 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:08.270139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec81868-6f96-4ea9-91af-34d0badc9780 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:08.274653 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec81868-6f96-4ea9-91af-34d0badc9780 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:08.274653 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec81868-6f96-4ea9-91af-34d0badc9780 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:08.288307 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 438/896] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:08.294289 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec81868-6f96-4ea9-91af-34d0badc9780 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:08.321016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:08.395003 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0697d-5b47-44e8-88a4-04a2102bf0bf None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:08.427394 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec81868-6f96-4ea9-91af-34d0badc9780 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:08.436320 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf293ba5-bc3f-42fd-93ab-dd43e3ff73d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:08.437087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf293ba5-bc3f-42fd-93ab-dd43e3ff73d5 None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:08.437713 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf293ba5-bc3f-42fd-93ab-dd43e3ff73d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:08.437825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf293ba5-bc3f-42fd-93ab-dd43e3ff73d5 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:08.438563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf293ba5-bc3f-42fd-93ab-dd43e3ff73d5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:08.440015 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf293ba5-bc3f-42fd-93ab-dd43e3ff73d5 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:08.468447 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8051f-6b76-4446-baba-ebbde377c366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:08.469166 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8051f-6b76-4446-baba-ebbde377c366 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:08.469445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8051f-6b76-4446-baba-ebbde377c366 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:08.469751 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8051f-6b76-4446-baba-ebbde377c366 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:08.478432 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c8051f-6b76-4446-baba-ebbde377c366 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:08.479811 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c8051f-6b76-4446-baba-ebbde377c366 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:08.491332 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-b9c8051f-6b76-4446-baba-ebbde377c366 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 20:27:08.491332 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:08.491332 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:08.491332 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:08.491332 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:08.491332 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:08.491332 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:08.491332 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:08.491332 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:08.491332 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:08.491332 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:08.491332 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:08.491332 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:27:08.491332 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:27:08.491332 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:27:08.491332 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:27:08.502912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:08.502912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:08.502912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:27:08.502912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:27:08.502912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:27:08.502912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:27:08.502912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:08.502912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:08.502912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:08.502912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:08.502912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:08.502912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:08.502912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:08.502912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:08.502912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:08.502912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:08.502912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:08.502912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:08.504099 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:08.504099 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:08.504099 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:27:08.504099 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:27:08.504099 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:27:08.504099 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:27:08.504099 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:27:08.504099 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:27:08.504099 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 20:27:08.504099 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:08.504099 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 439/897] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Aug 22 20:27:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:27:08.504099 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8051f-6b76-4446-baba-ebbde377c366 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:08.538376 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 459/898] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Aug 22 20:27:08 2022] POST /identity/v3/services => generated 241 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:27:08.540942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49eade-21e2-456f-b175-c60d383aceec None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:08.542495 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49eade-21e2-456f-b175-c60d383aceec None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:08.542495 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49eade-21e2-456f-b175-c60d383aceec None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:08.543796 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 460/899] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:08.549831 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f237d-fdf5-40e1-8038-49bea38c66c1 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:08.550448 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f237d-fdf5-40e1-8038-49bea38c66c1 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:08.551605 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f237d-fdf5-40e1-8038-49bea38c66c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:08.561115 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:08.580015 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-ed1f237d-fdf5-40e1-8038-49bea38c66c1 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:08.582397 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-ed1f237d-fdf5-40e1-8038-49bea38c66c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:08.636800 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8051f-6b76-4446-baba-ebbde377c366 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:08.694674 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 461/900] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:27:08.697186 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2594678-5391-421b-9544-4bdf7ec03f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:08.697802 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2594678-5391-421b-9544-4bdf7ec03f48 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:08.698084 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2594678-5391-421b-9544-4bdf7ec03f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:08.698358 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2594678-5391-421b-9544-4bdf7ec03f48 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:08.699084 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2594678-5391-421b-9544-4bdf7ec03f48 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:08.699387 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2594678-5391-421b-9544-4bdf7ec03f48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:08.701123 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2594678-5391-421b-9544-4bdf7ec03f48 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:08.723462 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 440/901] 10.222.0.62 () {56 vars in 1149 bytes} [Mon Aug 22 20:27:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:08.726946 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f237d-fdf5-40e1-8038-49bea38c66c1 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:08.759507 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:08.835198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f237d-fdf5-40e1-8038-49bea38c66c1 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:08.870523 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe44c4-fdb3-4e39-a3b3-fd922455ffa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:08.871129 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe44c4-fdb3-4e39-a3b3-fd922455ffa7 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:08.871407 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe44c4-fdb3-4e39-a3b3-fd922455ffa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:08.871681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe44c4-fdb3-4e39-a3b3-fd922455ffa7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:08.943346 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe44c4-fdb3-4e39-a3b3-fd922455ffa7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:08.944836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe44c4-fdb3-4e39-a3b3-fd922455ffa7 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:08.976064 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:08.980688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2594678-5391-421b-9544-4bdf7ec03f48 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:09.056013 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 462/902] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:27:08 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 20:27:09.064112 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe44c4-fdb3-4e39-a3b3-fd922455ffa7 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:09.113623 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2594678-5391-421b-9544-4bdf7ec03f48 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:09.115612 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:09.155883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2726c89-4cc2-4d3f-94e7-99da107e46c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:09.156514 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2726c89-4cc2-4d3f-94e7-99da107e46c6 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:09.156814 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2726c89-4cc2-4d3f-94e7-99da107e46c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:09.157103 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2726c89-4cc2-4d3f-94e7-99da107e46c6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:09.158214 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2726c89-4cc2-4d3f-94e7-99da107e46c6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:09.159581 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2726c89-4cc2-4d3f-94e7-99da107e46c6 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:09.172795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-f2726c89-4cc2-4d3f-94e7-99da107e46c6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 20:27:09.172795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:09.172795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:27:09.172795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:27:09.172795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:27:09.172795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:27:09.172795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:27:09.172795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:27:09.172795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 20:27:09.172795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:09.172795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:27:09.172795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:09.172795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:09.172795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:09.172795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:09.172795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:09.173873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:09.173873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:09.173873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:09.173873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:09.173873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:09.173873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:09.173873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:09.173873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:27:09.173873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:27:09.173873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:27:09.173873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:27:09.173873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:09.173873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:09.173873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:09.173873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:09.173873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:09.173873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:09.174745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:09.174745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:09.174745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:09.174745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:09.174745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:09.174745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:09.174745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:09.174745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:09.174745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:09.174745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:09.174745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:27:09.174745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:27:09.174745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 20:27:09.174745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:09.177486 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 441/903] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Aug 22 20:27:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:27:09.181937 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe44c4-fdb3-4e39-a3b3-fd922455ffa7 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:09.183053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2726c89-4cc2-4d3f-94e7-99da107e46c6 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:09.222559 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:09.230155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb6c9b-2719-4076-88ad-20ce6623d758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:09.231226 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb6c9b-2719-4076-88ad-20ce6623d758 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:09.231653 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb6c9b-2719-4076-88ad-20ce6623d758 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:09.232061 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb6c9b-2719-4076-88ad-20ce6623d758 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:09.244901 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb6c9b-2719-4076-88ad-20ce6623d758 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:09.246583 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb6c9b-2719-4076-88ad-20ce6623d758 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:09.262283 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-98bb6c9b-2719-4076-88ad-20ce6623d758 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:09.262283 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:09.262283 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:09.262283 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:09.262283 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:09.262283 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:09.262283 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:09.262283 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:09.262283 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:09.262283 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:09.262283 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:09.262283 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:09.262283 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:27:09.262283 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:27:09.262283 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:27:09.262283 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:27:09.263439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:09.263439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:09.263439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:09.263439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:09.263439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:09.263439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:09.263439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:09.263439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:09.263439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:09.263439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:09.263439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:09.263439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:09.263439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:09.263439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:09.263439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:09.263439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:09.263439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:27:09.264305 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:27:09.264305 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:09.264305 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:09.271072 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 463/904] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:09.272562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb6c9b-2719-4076-88ad-20ce6623d758 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:09.292974 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2726c89-4cc2-4d3f-94e7-99da107e46c6 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:09.329795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110138ff-a3da-4ebf-b420-c3f61e9d053f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:09.330310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110138ff-a3da-4ebf-b420-c3f61e9d053f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:09.330587 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110138ff-a3da-4ebf-b420-c3f61e9d053f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:09.330864 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110138ff-a3da-4ebf-b420-c3f61e9d053f None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:09.331487 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110138ff-a3da-4ebf-b420-c3f61e9d053f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:09.331851 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110138ff-a3da-4ebf-b420-c3f61e9d053f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:09.333289 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110138ff-a3da-4ebf-b420-c3f61e9d053f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:09.343035 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 442/905] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Aug 22 20:27:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:09.344041 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110138ff-a3da-4ebf-b420-c3f61e9d053f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:09.376528 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:09.382857 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb6c9b-2719-4076-88ad-20ce6623d758 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:09.418121 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae4706-b287-4d57-847b-c7d4fad2bd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:09.418951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae4706-b287-4d57-847b-c7d4fad2bd86 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:09.419461 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae4706-b287-4d57-847b-c7d4fad2bd86 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:09.420007 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae4706-b287-4d57-847b-c7d4fad2bd86 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:09.420883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae4706-b287-4d57-847b-c7d4fad2bd86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:09.421396 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae4706-b287-4d57-847b-c7d4fad2bd86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:09.423465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae4706-b287-4d57-847b-c7d4fad2bd86 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:09.440481 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 464/906] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:09.442807 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae4706-b287-4d57-847b-c7d4fad2bd86 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:09.451638 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110138ff-a3da-4ebf-b420-c3f61e9d053f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:09.488948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f48af-99ca-4818-8062-83179af23c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:09.489279 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f48af-99ca-4818-8062-83179af23c2d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:09.489550 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f48af-99ca-4818-8062-83179af23c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:09.489824 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f48af-99ca-4818-8062-83179af23c2d None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:09.490457 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f48af-99ca-4818-8062-83179af23c2d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:09.490797 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f48af-99ca-4818-8062-83179af23c2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:09.492251 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f48af-99ca-4818-8062-83179af23c2d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:09.493861 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:09.503725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 443/907] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Aug 22 20:27:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:09.504789 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f48af-99ca-4818-8062-83179af23c2d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:09.557001 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae4706-b287-4d57-847b-c7d4fad2bd86 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:09.593680 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a051df-e6f5-460a-88fd-80e6b823340a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:09.595213 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a051df-e6f5-460a-88fd-80e6b823340a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:09.595702 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a051df-e6f5-460a-88fd-80e6b823340a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:09.596039 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a051df-e6f5-460a-88fd-80e6b823340a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:09.603298 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a051df-e6f5-460a-88fd-80e6b823340a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:09.604759 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a051df-e6f5-460a-88fd-80e6b823340a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:09.605490 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:09.613465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f48af-99ca-4818-8062-83179af23c2d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:09.616948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-b4a051df-e6f5-460a-88fd-80e6b823340a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:27:09.616948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:09.616948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:09.616948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:09.616948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:09.616948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:09.616948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:09.616948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:09.616948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:09.616948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:09.616948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:09.616948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:09.616948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:27:09.616948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:27:09.616948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:27:09.618445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:27:09.618445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:09.618445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:09.618445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:09.618445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:09.618445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:09.618445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:09.618445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:09.618445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:09.618445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:09.618445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:09.618445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:09.618445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:09.618445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:09.618445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:09.618445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:09.618445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:09.619395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:27:09.619395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:27:09.619395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:27:09.619395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:27:09.619395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:27:09.619395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:27:09.619395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:27:09.619395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:09.622718 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 465/908] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:27:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:27:09.624239 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311960e4-9f69-45ad-ae20-fa2e4bcc0b88 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:09.624507 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311960e4-9f69-45ad-ae20-fa2e4bcc0b88 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:09.624805 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311960e4-9f69-45ad-ae20-fa2e4bcc0b88 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:09.626253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 466/909] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:09.627029 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311960e4-9f69-45ad-ae20-fa2e4bcc0b88 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:09.660586 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39c603-e193-4209-96b3-bd7b747d3c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:09.661241 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39c603-e193-4209-96b3-bd7b747d3c94 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:09.661520 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39c603-e193-4209-96b3-bd7b747d3c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:09.661791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39c603-e193-4209-96b3-bd7b747d3c94 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:09.662506 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39c603-e193-4209-96b3-bd7b747d3c94 None admin] RBAC: Adding query filter params (interface=public, service_id=8bb460857c6d4ef3a42e10f9ca4089ed, region_id=RegionOne) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:09.662789 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39c603-e193-4209-96b3-bd7b747d3c94 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:09.664459 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39c603-e193-4209-96b3-bd7b747d3c94 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:09.673623 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 444/910] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Aug 22 20:27:09 2022] GET /identity/v3/endpoints?service_id=8bb460857c6d4ef3a42e10f9ca4089ed&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:09.675027 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8926a-79c6-4133-8a7d-df5573c94450 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:09.675404 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8926a-79c6-4133-8a7d-df5573c94450 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:09.675753 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8926a-79c6-4133-8a7d-df5573c94450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:09.694133 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-01e8926a-79c6-4133-8a7d-df5573c94450 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:09.695330 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-01e8926a-79c6-4133-8a7d-df5573c94450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:09.742632 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311960e4-9f69-45ad-ae20-fa2e4bcc0b88 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:09.744332 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:09.770899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 445/911] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:27:09.771680 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8926a-79c6-4133-8a7d-df5573c94450 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:09.788363 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f81cf-87df-4955-abfe-ca6514b6cb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:09.789912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f81cf-87df-4955-abfe-ca6514b6cb04 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:09.790844 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f81cf-87df-4955-abfe-ca6514b6cb04 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:09.791325 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f81cf-87df-4955-abfe-ca6514b6cb04 None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:09.792211 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f81cf-87df-4955-abfe-ca6514b6cb04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:09.792759 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f81cf-87df-4955-abfe-ca6514b6cb04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:09.795191 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f81cf-87df-4955-abfe-ca6514b6cb04 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:09.816158 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 467/912] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 22 20:27:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:09.817953 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f81cf-87df-4955-abfe-ca6514b6cb04 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:09.875248 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:09.887981 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8926a-79c6-4133-8a7d-df5573c94450 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:09.925205 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64586443-d1c8-4f88-bfa3-55a2bae09d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:09.925810 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64586443-d1c8-4f88-bfa3-55a2bae09d02 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:09.926088 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64586443-d1c8-4f88-bfa3-55a2bae09d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:09.926360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64586443-d1c8-4f88-bfa3-55a2bae09d02 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:09.927243 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64586443-d1c8-4f88-bfa3-55a2bae09d02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:09.928404 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64586443-d1c8-4f88-bfa3-55a2bae09d02 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:09.934982 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 446/913] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Aug 22 20:27:09 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:27:09.958320 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f81cf-87df-4955-abfe-ca6514b6cb04 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:09.997452 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fef8d5-1dd4-4597-be8a-cfd8d75cc669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:09.998331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fef8d5-1dd4-4597-be8a-cfd8d75cc669 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:09.998780 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fef8d5-1dd4-4597-be8a-cfd8d75cc669 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:09.999191 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fef8d5-1dd4-4597-be8a-cfd8d75cc669 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:10.000143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fef8d5-1dd4-4597-be8a-cfd8d75cc669 None admin] RBAC: Adding query filter params (role.id=0f0fc9106edb4456b2eafeeb4de00cc2, scope.project.id=783c362712d34405ab827e3f00a67995, user.id=51ed4c996cde4e88be26544c48200695) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:10.000595 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fef8d5-1dd4-4597-be8a-cfd8d75cc669 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:10.002617 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fef8d5-1dd4-4597-be8a-cfd8d75cc669 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:10.017013 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 468/914] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:27:09 2022] GET /identity/v3/role_assignments?user.id=51ed4c996cde4e88be26544c48200695&scope.project.id=783c362712d34405ab827e3f00a67995&role.id=0f0fc9106edb4456b2eafeeb4de00cc2 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:10.057834 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64586443-d1c8-4f88-bfa3-55a2bae09d02 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:10.184063 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64586443-d1c8-4f88-bfa3-55a2bae09d02 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:10.221086 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439088bd-9297-4e28-94c0-9147fbb72e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:10.221726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439088bd-9297-4e28-94c0-9147fbb72e61 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:10.222007 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439088bd-9297-4e28-94c0-9147fbb72e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:10.222277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439088bd-9297-4e28-94c0-9147fbb72e61 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:10.222858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439088bd-9297-4e28-94c0-9147fbb72e61 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:10.224359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439088bd-9297-4e28-94c0-9147fbb72e61 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:10.233277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-439088bd-9297-4e28-94c0-9147fbb72e61 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 20:27:10.233277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:10.233277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:27:10.233277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:27:10.233277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:27:10.233277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:27:10.233277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:27:10.233277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:27:10.233277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 20:27:10.233277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:10.233277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:27:10.233277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:10.233277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:10.233277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:10.233277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:10.233277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:10.233277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:10.234249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:10.234249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:10.234249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:10.234249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:10.234249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:10.234249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:10.234249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:27:10.234249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:27:10.234249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:27:10.234249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:27:10.234249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:10.234249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:10.234249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:10.234249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:10.234249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:10.234249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:10.236438 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:10.236438 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:10.236438 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:10.236438 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:10.236438 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:10.236438 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:10.236438 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:10.236438 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:10.236438 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:10.236438 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:10.236438 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:27:10.236438 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:27:10.236438 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 20:27:10.236438 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:10.236438 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 447/915] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 22 20:27:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:10.241149 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fef8d5-1dd4-4597-be8a-cfd8d75cc669 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:10.270898 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:10.349454 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fef8d5-1dd4-4597-be8a-cfd8d75cc669 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:10.386743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001cd49-8f21-475a-a7a8-39f075dbe7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:10.387693 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001cd49-8f21-475a-a7a8-39f075dbe7ae None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:10.388209 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001cd49-8f21-475a-a7a8-39f075dbe7ae None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:10.388773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001cd49-8f21-475a-a7a8-39f075dbe7ae None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:10.389608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001cd49-8f21-475a-a7a8-39f075dbe7ae None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:10.390099 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001cd49-8f21-475a-a7a8-39f075dbe7ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:10.391670 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001cd49-8f21-475a-a7a8-39f075dbe7ae None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:10.397387 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 469/916] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 22 20:27:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:10.402722 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439088bd-9297-4e28-94c0-9147fbb72e61 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:10.423682 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:10.514058 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439088bd-9297-4e28-94c0-9147fbb72e61 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:10.552098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d7906-82ef-4732-baa4-4707665207b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:10.553529 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d7906-82ef-4732-baa4-4707665207b9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:10.554211 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d7906-82ef-4732-baa4-4707665207b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:10.554887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d7906-82ef-4732-baa4-4707665207b9 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:10.555716 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d7906-82ef-4732-baa4-4707665207b9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:10.556217 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d7906-82ef-4732-baa4-4707665207b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:10.557811 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d7906-82ef-4732-baa4-4707665207b9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:10.564250 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 448/917] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Aug 22 20:27:10 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:10.572888 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001cd49-8f21-475a-a7a8-39f075dbe7ae None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:10.573464 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1e9be-9716-417e-bbcd-f1a9cff45451 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:10.573764 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1e9be-9716-417e-bbcd-f1a9cff45451 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:10.574030 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1e9be-9716-417e-bbcd-f1a9cff45451 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:10.575839 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 449/918] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:27:10.582889 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed0b26-7a57-471a-93ca-eb81afd24e76 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:10.583280 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed0b26-7a57-471a-93ca-eb81afd24e76 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:10.583564 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed0b26-7a57-471a-93ca-eb81afd24e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:10.604924 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-36ed0b26-7a57-471a-93ca-eb81afd24e76 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:10.606462 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-36ed0b26-7a57-471a-93ca-eb81afd24e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:10.677484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:10.688015 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001cd49-8f21-475a-a7a8-39f075dbe7ae None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:10.700783 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 450/919] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:27:10.734076 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65b370-92c3-4b38-877a-6e9e5c028d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:10.735066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65b370-92c3-4b38-877a-6e9e5c028d95 None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:10.736113 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65b370-92c3-4b38-877a-6e9e5c028d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:10.736610 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65b370-92c3-4b38-877a-6e9e5c028d95 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:10.737792 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65b370-92c3-4b38-877a-6e9e5c028d95 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:10.739425 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65b370-92c3-4b38-877a-6e9e5c028d95 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:10.817562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 470/920] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 22 20:27:10 2022] POST /identity/v3/endpoints => generated 346 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:27:10.968991 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed0b26-7a57-471a-93ca-eb81afd24e76 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:10.981841 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:11.082432 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed0b26-7a57-471a-93ca-eb81afd24e76 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:11.128110 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa8278-c8fe-48d4-bc60-0d088e995265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:11.128771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa8278-c8fe-48d4-bc60-0d088e995265 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:11.129052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa8278-c8fe-48d4-bc60-0d088e995265 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:11.129323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa8278-c8fe-48d4-bc60-0d088e995265 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:11.130010 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fa8278-c8fe-48d4-bc60-0d088e995265 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:11.131394 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fa8278-c8fe-48d4-bc60-0d088e995265 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:11.140193 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-14fa8278-c8fe-48d4-bc60-0d088e995265 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 20:27:11.140193 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:11.140193 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:27:11.140193 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:27:11.140193 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:27:11.140193 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:27:11.140193 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:27:11.140193 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:27:11.140193 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 20:27:11.140193 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:11.140193 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:27:11.140193 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:11.140193 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:11.140193 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:11.140193 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:11.140193 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:11.140193 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:11.141236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:11.141236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:11.141236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:11.141236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:11.141236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:11.141236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:11.141236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:27:11.141236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:27:11.141236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:27:11.141236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:27:11.141236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:11.141236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:11.141236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:11.141236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:11.141236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:11.141236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:11.142613 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:11.142613 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:11.142613 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:11.142613 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:11.142613 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:11.142613 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:11.142613 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:11.142613 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:11.142613 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:11.142613 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:11.142613 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:27:11.142613 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:27:11.142613 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 20:27:11.142613 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:11.142613 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 451/921] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Aug 22 20:27:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:11.149511 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65b370-92c3-4b38-877a-6e9e5c028d95 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:11.264468 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65b370-92c3-4b38-877a-6e9e5c028d95 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:11.299958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698915d-417e-4381-bc8a-6848e071ee97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:11.300931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698915d-417e-4381-bc8a-6848e071ee97 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:11.301406 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698915d-417e-4381-bc8a-6848e071ee97 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:11.301872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698915d-417e-4381-bc8a-6848e071ee97 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:11.302691 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1698915d-417e-4381-bc8a-6848e071ee97 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:11.303222 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1698915d-417e-4381-bc8a-6848e071ee97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:11.304787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1698915d-417e-4381-bc8a-6848e071ee97 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:11.309961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 471/922] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Aug 22 20:27:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:11.316168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa8278-c8fe-48d4-bc60-0d088e995265 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:11.388521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:11.420517 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa8278-c8fe-48d4-bc60-0d088e995265 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:11.456615 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521481b9-367f-4278-a28c-011e9dd7f878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:11.457323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521481b9-367f-4278-a28c-011e9dd7f878 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:11.457604 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521481b9-367f-4278-a28c-011e9dd7f878 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:11.457871 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521481b9-367f-4278-a28c-011e9dd7f878 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:11.458500 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521481b9-367f-4278-a28c-011e9dd7f878 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:11.458796 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521481b9-367f-4278-a28c-011e9dd7f878 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:11.460176 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521481b9-367f-4278-a28c-011e9dd7f878 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:11.465510 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 452/923] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Aug 22 20:27:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:11.471602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698915d-417e-4381-bc8a-6848e071ee97 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:11.486096 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:11.582984 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698915d-417e-4381-bc8a-6848e071ee97 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:11.618338 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ec5e9-a235-44a3-b2b0-5f123dc0e28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:11.618942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ec5e9-a235-44a3-b2b0-5f123dc0e28e None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:11.619220 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ec5e9-a235-44a3-b2b0-5f123dc0e28e None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:11.619547 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ec5e9-a235-44a3-b2b0-5f123dc0e28e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:11.620243 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ec5e9-a235-44a3-b2b0-5f123dc0e28e None admin] RBAC: Adding query filter params (interface=public, service_id=9eff7fb171454a5e83e756be97bee974, region_id=RegionOne) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:11.620550 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ec5e9-a235-44a3-b2b0-5f123dc0e28e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:11.621939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ec5e9-a235-44a3-b2b0-5f123dc0e28e None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:11.627952 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 472/924] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Aug 22 20:27:11 2022] GET /identity/v3/endpoints?service_id=9eff7fb171454a5e83e756be97bee974&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:11.633422 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521481b9-367f-4278-a28c-011e9dd7f878 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:11.741285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521481b9-367f-4278-a28c-011e9dd7f878 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:11.777750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65430949-1b8e-489d-b803-0c49dbee9281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:11.778363 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65430949-1b8e-489d-b803-0c49dbee9281 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:11.778647 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65430949-1b8e-489d-b803-0c49dbee9281 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:11.778922 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65430949-1b8e-489d-b803-0c49dbee9281 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:11.779530 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65430949-1b8e-489d-b803-0c49dbee9281 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:11.780934 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65430949-1b8e-489d-b803-0c49dbee9281 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:11.781987 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:11.787684 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 453/925] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Aug 22 20:27:11 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:27:12.069943 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfd0dc-1651-4e34-9709-e9bfed1e45f0 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:12.070955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfd0dc-1651-4e34-9709-e9bfed1e45f0 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:12.071440 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfd0dc-1651-4e34-9709-e9bfed1e45f0 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:12.073282 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 473/926] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:12.078960 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91bb86-ebd0-4642-9d37-60ee616e4969 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:12.079443 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91bb86-ebd0-4642-9d37-60ee616e4969 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:12.079925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91bb86-ebd0-4642-9d37-60ee616e4969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:12.096551 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69794649-5e5e-421d-972d-bbca04cc7279 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:12.096895 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69794649-5e5e-421d-972d-bbca04cc7279 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:12.097130 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69794649-5e5e-421d-972d-bbca04cc7279 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:12.098765 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 474/927] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:27:12.099446 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-dc91bb86-ebd0-4642-9d37-60ee616e4969 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:12.100748 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-dc91bb86-ebd0-4642-9d37-60ee616e4969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:12.103671 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4089b9-7ca5-415f-a709-03209d24e64e None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:12.103956 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4089b9-7ca5-415f-a709-03209d24e64e None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:12.104224 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4089b9-7ca5-415f-a709-03209d24e64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:12.122631 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-8d4089b9-7ca5-415f-a709-03209d24e64e None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:12.123807 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-8d4089b9-7ca5-415f-a709-03209d24e64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:12.174594 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 454/928] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:27:12.197370 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 475/929] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:27:12.454811 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91bb86-ebd0-4642-9d37-60ee616e4969 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:12.467829 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4089b9-7ca5-415f-a709-03209d24e64e None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:12.471650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:12.564980 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91bb86-ebd0-4642-9d37-60ee616e4969 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:12.574151 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4089b9-7ca5-415f-a709-03209d24e64e None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:12.596924 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:12.608218 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd69c6-2181-49bc-b506-26e290707250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:12.609337 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd69c6-2181-49bc-b506-26e290707250 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:12.609617 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd69c6-2181-49bc-b506-26e290707250 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:12.609913 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd69c6-2181-49bc-b506-26e290707250 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:12.619912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1df1c-75b9-4389-a473-9506573bc817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:12.620867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1df1c-75b9-4389-a473-9506573bc817 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:12.621600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1df1c-75b9-4389-a473-9506573bc817 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:12.621962 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddd69c6-2181-49bc-b506-26e290707250 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:27:12.622246 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1df1c-75b9-4389-a473-9506573bc817 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:12.623001 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea1df1c-75b9-4389-a473-9506573bc817 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:12.624551 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea1df1c-75b9-4389-a473-9506573bc817 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:12.627846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-bddd69c6-2181-49bc-b506-26e290707250 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 20:27:12.627846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:12.627846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:12.627846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:12.627846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:12.627846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:12.627846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:12.627846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:12.627846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:12.627846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:12.627846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:12.627846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:12.627846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:27:12.627846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:27:12.627846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:27:12.627846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:27:12.634743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:27:12.634743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:27:12.634743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:27:12.634743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:27:12.634743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:12.634743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:12.634743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:12.634743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:12.634743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:12.634743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:12.634743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:12.634743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:12.634743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:12.634743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:12.634743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:12.634743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:12.635716 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:12.635716 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:12.635716 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:12.635716 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:12.635716 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:27:12.635716 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:27:12.635716 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:27:12.635716 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:27:12.635716 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:27:12.635716 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:27:12.635716 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 20:27:12.635716 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:12.635716 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 455/930] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Aug 22 20:27:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:12.637762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd69c6-2181-49bc-b506-26e290707250 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:12.641008 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-aea1df1c-75b9-4389-a473-9506573bc817 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 20:27:12.641008 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:12.641008 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:27:12.641008 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:27:12.641008 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:27:12.641008 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:27:12.641008 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:27:12.641008 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:27:12.641008 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 20:27:12.641008 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:12.641008 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:27:12.641008 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:12.641008 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:12.641008 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:12.641008 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:12.641008 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:12.643004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:12.643004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:12.643004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:12.643004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:12.643004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:12.643004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:12.643004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:12.643004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:27:12.643004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:27:12.643004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:27:12.643004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:27:12.643004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:12.643004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:12.643004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:12.643004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:12.643004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:12.643004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:12.643908 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:12.643908 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:12.643908 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:12.643908 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:12.643908 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:12.643908 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:12.643908 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:12.643908 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:12.643908 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:12.643908 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:12.643908 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:27:12.643908 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:27:12.643908 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 20:27:12.643908 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:12.647663 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 476/931] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Aug 22 20:27:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:27:12.650153 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1df1c-75b9-4389-a473-9506573bc817 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:12.733270 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:12.771752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddd69c6-2181-49bc-b506-26e290707250 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:12.787777 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1df1c-75b9-4389-a473-9506573bc817 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:12.818288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935e9c9-be82-4580-b099-a52d1a017134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:12.819311 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935e9c9-be82-4580-b099-a52d1a017134 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:12.819737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935e9c9-be82-4580-b099-a52d1a017134 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:12.820150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935e9c9-be82-4580-b099-a52d1a017134 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:12.821546 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935e9c9-be82-4580-b099-a52d1a017134 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:12.821999 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935e9c9-be82-4580-b099-a52d1a017134 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:12.823990 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1935e9c9-be82-4580-b099-a52d1a017134 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:12.832818 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca71f28-f249-419a-845b-29d361da7e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:12.833266 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca71f28-f249-419a-845b-29d361da7e66 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:12.833641 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca71f28-f249-419a-845b-29d361da7e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:12.834022 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca71f28-f249-419a-845b-29d361da7e66 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:12.834802 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca71f28-f249-419a-845b-29d361da7e66 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:12.835205 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca71f28-f249-419a-845b-29d361da7e66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:12.836848 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca71f28-f249-419a-845b-29d361da7e66 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:12.841866 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 456/932] 10.222.0.62 () {56 vars in 1115 bytes} [Mon Aug 22 20:27:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:12.843335 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935e9c9-be82-4580-b099-a52d1a017134 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:12.850955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 477/933] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Aug 22 20:27:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:12.851957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca71f28-f249-419a-845b-29d361da7e66 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:12.909599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:12.967206 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca71f28-f249-419a-845b-29d361da7e66 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:12.974098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935e9c9-be82-4580-b099-a52d1a017134 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:12.999171 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:13.004783 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477b4aa-eccc-4550-8ae8-7098bece7c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:13.005455 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477b4aa-eccc-4550-8ae8-7098bece7c33 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:13.005661 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477b4aa-eccc-4550-8ae8-7098bece7c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:13.005934 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477b4aa-eccc-4550-8ae8-7098bece7c33 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:13.006562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a477b4aa-eccc-4550-8ae8-7098bece7c33 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:13.006863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a477b4aa-eccc-4550-8ae8-7098bece7c33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:13.008216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a477b4aa-eccc-4550-8ae8-7098bece7c33 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:13.010596 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3449762-4bed-41e2-984c-6014e4580487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:13.012073 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3449762-4bed-41e2-984c-6014e4580487 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:13.012073 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3449762-4bed-41e2-984c-6014e4580487 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:13.012073 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3449762-4bed-41e2-984c-6014e4580487 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:13.017639 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 478/934] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Aug 22 20:27:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:13.017639 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278c016-729b-4cde-a9e5-faeff4de282b None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:13.017639 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278c016-729b-4cde-a9e5-faeff4de282b None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:13.017639 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278c016-729b-4cde-a9e5-faeff4de282b None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:13.017639 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 479/935] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:13.018322 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278c016-729b-4cde-a9e5-faeff4de282b None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:13.029633 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3449762-4bed-41e2-984c-6014e4580487 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:13.031089 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3449762-4bed-41e2-984c-6014e4580487 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:13.045371 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-f3449762-4bed-41e2-984c-6014e4580487 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:13.045371 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:13.045371 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:13.045371 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:13.045371 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:13.045371 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:13.045371 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:13.045371 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:13.045371 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:13.045371 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:13.045371 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:13.045371 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:13.045371 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:27:13.045371 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:27:13.045371 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:27:13.045371 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:27:13.046300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:13.046300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:13.046300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:13.046300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:13.046300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:13.046300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:13.046300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:13.046300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:13.046300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:13.046300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:13.046300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:13.046300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:13.046300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:13.046300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:13.046300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:13.046300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:13.046300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:27:13.049844 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:27:13.049844 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:13.049844 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:13.049844 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 457/936] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:13.049844 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354baab8-3993-40f0-b4a3-501f4a4a8e40 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:13.049844 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354baab8-3993-40f0-b4a3-501f4a4a8e40 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:13.049844 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354baab8-3993-40f0-b4a3-501f4a4a8e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:13.068679 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-354baab8-3993-40f0-b4a3-501f4a4a8e40 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:13.069894 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-354baab8-3993-40f0-b4a3-501f4a4a8e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:13.136808 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278c016-729b-4cde-a9e5-faeff4de282b None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:13.141682 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 458/937] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:27:13.143018 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354baab8-3993-40f0-b4a3-501f4a4a8e40 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:13.180558 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:13.181714 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b554cd-b9ae-44f0-9888-c4a6d70cd83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:13.182675 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b554cd-b9ae-44f0-9888-c4a6d70cd83d None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:13.183176 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b554cd-b9ae-44f0-9888-c4a6d70cd83d None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:13.183617 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b554cd-b9ae-44f0-9888-c4a6d70cd83d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:13.184444 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b554cd-b9ae-44f0-9888-c4a6d70cd83d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:13.186083 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b554cd-b9ae-44f0-9888-c4a6d70cd83d None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:13.252252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354baab8-3993-40f0-b4a3-501f4a4a8e40 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:13.286994 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583dbbd6-e73e-434e-860a-5b5aa1a682b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:13.287651 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583dbbd6-e73e-434e-860a-5b5aa1a682b3 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:13.287932 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583dbbd6-e73e-434e-860a-5b5aa1a682b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:13.288198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583dbbd6-e73e-434e-860a-5b5aa1a682b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:13.288857 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583dbbd6-e73e-434e-860a-5b5aa1a682b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:13.289156 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583dbbd6-e73e-434e-860a-5b5aa1a682b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:13.290584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583dbbd6-e73e-434e-860a-5b5aa1a682b3 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:13.302797 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 459/938] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:13.308083 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583dbbd6-e73e-434e-860a-5b5aa1a682b3 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:13.333269 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 480/939] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 22 20:27:13 2022] POST /identity/v3/endpoints => generated 347 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:27:13.417161 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b554cd-b9ae-44f0-9888-c4a6d70cd83d None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:13.426740 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:13.438447 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583dbbd6-e73e-434e-860a-5b5aa1a682b3 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:13.477975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:13.497466 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429e950-dde5-4b2e-b716-8a970b27f293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:13.498121 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429e950-dde5-4b2e-b716-8a970b27f293 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:13.498446 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429e950-dde5-4b2e-b716-8a970b27f293 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:13.498723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429e950-dde5-4b2e-b716-8a970b27f293 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:13.510747 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429e950-dde5-4b2e-b716-8a970b27f293 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:13.512135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429e950-dde5-4b2e-b716-8a970b27f293 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:13.526173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-7429e950-dde5-4b2e-b716-8a970b27f293 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 20:27:13.526173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:13.526173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:13.526173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:13.526173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:13.526173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:13.526173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:13.526173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:13.526173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:13.526173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:13.526173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:13.526173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:13.526173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:27:13.526173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:27:13.526173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:27:13.526173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:27:13.531927 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:13.531927 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:13.531927 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:27:13.531927 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:27:13.531927 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:27:13.531927 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:27:13.531927 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:13.531927 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:13.531927 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:13.531927 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:13.531927 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:13.531927 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:13.531927 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:13.531927 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:13.531927 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:13.531927 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:13.531927 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:13.531927 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:13.532923 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:13.532923 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:13.532923 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:27:13.532923 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:27:13.532923 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:27:13.532923 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:27:13.532923 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:27:13.532923 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:27:13.532923 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 20:27:13.532923 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:13.532923 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 460/940] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Aug 22 20:27:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:27:13.535904 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429e950-dde5-4b2e-b716-8a970b27f293 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:13.551051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b554cd-b9ae-44f0-9888-c4a6d70cd83d None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:13.603383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aca46d-fa9f-4e3f-9d21-234d828637f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:13.604115 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aca46d-fa9f-4e3f-9d21-234d828637f5 None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:13.604397 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aca46d-fa9f-4e3f-9d21-234d828637f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:13.604688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aca46d-fa9f-4e3f-9d21-234d828637f5 None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:13.605363 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aca46d-fa9f-4e3f-9d21-234d828637f5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:13.606911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aca46d-fa9f-4e3f-9d21-234d828637f5 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:13.609545 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: WARNING keystone.server.flask.common [None req-49aca46d-fa9f-4e3f-9d21-234d828637f5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 22 20:27:13.665127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.sql.core [None req-49aca46d-fa9f-4e3f-9d21-234d828637f5 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 22 20:27:13.665127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 22 20:27:13.665127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [parameters: {'id': '55ac49f84fab4960b250cbb93edeaf2c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 22 20:27:13.665127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81637) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 22 20:27:13.680952 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429e950-dde5-4b2e-b716-8a970b27f293 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:13.693119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-49aca46d-fa9f-4e3f-9d21-234d828637f5 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 55ac49f84fab4960b250cbb93edeaf2c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 55ac49f84fab4960b250cbb93edeaf2c. Aug 22 20:27:13.693119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:13.693119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 20:27:13.693119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 20:27:13.693119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 20:27:13.693119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 20:27:13.693119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 20:27:13.693119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 20:27:13.693119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 20:27:13.693119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application conn.query(q) Aug 22 20:27:13.693119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 20:27:13.693119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 20:27:13.693119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 20:27:13.694640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application result.read() Aug 22 20:27:13.694640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 20:27:13.694640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 20:27:13.694640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 20:27:13.694640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 20:27:13.694640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 20:27:13.694640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 20:27:13.694640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 20:27:13.694640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 20:27:13.694640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 22 20:27:13.694640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:13.694640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 22 20:27:13.694640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:13.694640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:13.694640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 22 20:27:13.694640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 22 20:27:13.694640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 22 20:27:13.694640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 22 20:27:13.696429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 20:27:13.696429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application next(self.gen) Aug 22 20:27:13.696429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 22 20:27:13.696429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application yield resource Aug 22 20:27:13.696429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 20:27:13.696429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application next(self.gen) Aug 22 20:27:13.696429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 22 20:27:13.696429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application self.session.rollback() Aug 22 20:27:13.696429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 20:27:13.696429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application self.force_reraise() Aug 22 20:27:13.696429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 20:27:13.696429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise self.value Aug 22 20:27:13.696429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 22 20:27:13.696429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 22 20:27:13.696429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 22 20:27:13.696429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application session.commit() Aug 22 20:27:13.696429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 22 20:27:13.700331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 22 20:27:13.700331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 22 20:27:13.700331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._prepare_impl() Aug 22 20:27:13.700331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 22 20:27:13.700331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application self.session.flush() Aug 22 20:27:13.700331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 22 20:27:13.700331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._flush(objects) Aug 22 20:27:13.700331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 22 20:27:13.700331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 22 20:27:13.700331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 22 20:27:13.700331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application compat.raise_( Aug 22 20:27:13.700331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 20:27:13.700331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception Aug 22 20:27:13.700331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 22 20:27:13.700331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application flush_context.execute() Aug 22 20:27:13.700331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 22 20:27:13.700331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rec.execute(self) Aug 22 20:27:13.704496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 22 20:27:13.704496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 22 20:27:13.704496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 22 20:27:13.704496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 22 20:27:13.704496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 22 20:27:13.704496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 22 20:27:13.704496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 22 20:27:13.704496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 22 20:27:13.704496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 22 20:27:13.704496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 22 20:27:13.704496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 22 20:27:13.704496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 22 20:27:13.704496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 22 20:27:13.704496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 22 20:27:13.704496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 22 20:27:13.708505 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 22 20:27:13.708505 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 20:27:13.708505 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception Aug 22 20:27:13.708505 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 20:27:13.708505 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 20:27:13.708505 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 20:27:13.708505 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 20:27:13.708505 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 20:27:13.708505 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 20:27:13.708505 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 20:27:13.708505 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application conn.query(q) Aug 22 20:27:13.708505 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 20:27:13.708505 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 20:27:13.708505 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 20:27:13.708505 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application result.read() Aug 22 20:27:13.708505 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 20:27:13.708505 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 20:27:13.712255 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 20:27:13.712255 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 20:27:13.712255 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 20:27:13.712255 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 20:27:13.712255 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 20:27:13.712255 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 20:27:13.712255 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 22 20:27:13.712255 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 22 20:27:13.712255 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [parameters: {'id': '55ac49f84fab4960b250cbb93edeaf2c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 22 20:27:13.712255 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 22 20:27:13.712255 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:13.712255 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:27:13.712255 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:13.712255 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:13.712255 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 22 20:27:13.719424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 22 20:27:13.719424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 22 20:27:13.719424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 22 20:27:13.719424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 22 20:27:13.719424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:13.719424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:27:13.719424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:13.719424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:13.719424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:13.719424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:13.719424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:13.719424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:13.719424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:13.719424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:13.719424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:13.719424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:13.719424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:13.722574 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:13.722574 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 22 20:27:13.722574 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 22 20:27:13.722574 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:13.722574 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:13.722574 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 22 20:27:13.722574 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 22 20:27:13.722574 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 55ac49f84fab4960b250cbb93edeaf2c. Aug 22 20:27:13.722574 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:13.722574 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 481/941] 10.222.0.62 () {60 vars in 1140 bytes} [Mon Aug 22 20:27:13 2022] POST /identity/v3/projects => generated 262 bytes in 295 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:27:13.722574 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aca46d-fa9f-4e3f-9d21-234d828637f5 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:13.730288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370409d-e173-4721-a6ba-aaf7201ec6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:13.731135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370409d-e173-4721-a6ba-aaf7201ec6ec None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:13.731419 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370409d-e173-4721-a6ba-aaf7201ec6ec None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:13.731747 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370409d-e173-4721-a6ba-aaf7201ec6ec None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:13.732494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a370409d-e173-4721-a6ba-aaf7201ec6ec None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:13.732888 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a370409d-e173-4721-a6ba-aaf7201ec6ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:13.734401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a370409d-e173-4721-a6ba-aaf7201ec6ec None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:13.772836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 461/942] 10.222.0.62 () {56 vars in 1149 bytes} [Mon Aug 22 20:27:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:13.777318 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370409d-e173-4721-a6ba-aaf7201ec6ec None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:13.788608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:13.877938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aca46d-fa9f-4e3f-9d21-234d828637f5 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:13.889053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:13.910703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370409d-e173-4721-a6ba-aaf7201ec6ec None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:13.920009 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0114dc-8fbf-4f28-a8bf-db0c63dc4995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:13.921212 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0114dc-8fbf-4f28-a8bf-db0c63dc4995 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:13.921851 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0114dc-8fbf-4f28-a8bf-db0c63dc4995 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:13.923836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0114dc-8fbf-4f28-a8bf-db0c63dc4995 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:13.931188 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0114dc-8fbf-4f28-a8bf-db0c63dc4995 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:13.933547 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0114dc-8fbf-4f28-a8bf-db0c63dc4995 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:13.945936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-8e0114dc-8fbf-4f28-a8bf-db0c63dc4995 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:27:13.945936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:13.945936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:13.945936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:13.945936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:13.945936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:13.945936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:13.945936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:13.945936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:13.945936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:13.945936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:13.945936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:13.945936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:27:13.945936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:27:13.945936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:27:13.947035 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:27:13.947035 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:13.947035 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:13.947035 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:13.947035 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:13.947035 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:13.947035 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:13.947035 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:13.947035 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:13.947035 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:13.947035 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:13.947035 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:13.947035 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:13.947035 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:13.947035 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:13.947035 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:13.947035 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:13.947926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:27:13.947926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:27:13.947926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:27:13.947926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:27:13.947926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:27:13.947926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:27:13.947926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:27:13.947926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:13.947926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 482/943] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:27:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:13.948559 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79c0c5-3d0c-4979-b778-6df8e5dc73aa None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:13.948897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79c0c5-3d0c-4979-b778-6df8e5dc73aa None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:13.949528 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79c0c5-3d0c-4979-b778-6df8e5dc73aa None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:13.956798 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 483/944] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:13.956798 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79c0c5-3d0c-4979-b778-6df8e5dc73aa None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:13.958031 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8cf6cf-13db-425d-bc14-0ce0928f0e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:13.958976 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cf6cf-13db-425d-bc14-0ce0928f0e85 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:13.959445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cf6cf-13db-425d-bc14-0ce0928f0e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:13.959838 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cf6cf-13db-425d-bc14-0ce0928f0e85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:13.972674 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8cf6cf-13db-425d-bc14-0ce0928f0e85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:13.974270 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8cf6cf-13db-425d-bc14-0ce0928f0e85 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:13.989788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-3c8cf6cf-13db-425d-bc14-0ce0928f0e85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:13.989788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:13.989788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:13.989788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:13.989788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:13.989788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:13.989788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:13.989788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:13.989788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:13.989788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:13.989788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:13.989788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:13.989788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:27:13.989788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:27:13.989788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:27:13.989788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:27:13.990931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:13.990931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:13.990931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:13.990931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:13.990931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:13.990931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:13.990931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:13.990931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:13.990931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:13.990931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:13.990931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:13.990931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:13.990931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:13.990931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:13.990931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:13.990931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:13.990931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:27:13.991924 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:27:13.991924 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:13.991924 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:13.991924 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 462/945] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:27:13.993035 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a87140-6040-406a-b9e0-9ce83c2d0b7b None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:13.993455 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a87140-6040-406a-b9e0-9ce83c2d0b7b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:13.993738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a87140-6040-406a-b9e0-9ce83c2d0b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:14.021386 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-a9a87140-6040-406a-b9e0-9ce83c2d0b7b None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:14.022471 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a9a87140-6040-406a-b9e0-9ce83c2d0b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:14.087863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:14.094750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79c0c5-3d0c-4979-b778-6df8e5dc73aa None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:14.105237 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 463/946] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:27:14.106583 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a87140-6040-406a-b9e0-9ce83c2d0b7b None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:14.132673 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce7682-9810-4e9e-9256-04d186876b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:14.133562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce7682-9810-4e9e-9256-04d186876b87 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:14.133887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce7682-9810-4e9e-9256-04d186876b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:14.134159 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce7682-9810-4e9e-9256-04d186876b87 None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:14.134880 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce7682-9810-4e9e-9256-04d186876b87 None admin] RBAC: Adding query filter params (name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:14.135178 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce7682-9810-4e9e-9256-04d186876b87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:14.136651 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce7682-9810-4e9e-9256-04d186876b87 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:14.161138 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 484/947] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Aug 22 20:27:13 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:14.250118 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a87140-6040-406a-b9e0-9ce83c2d0b7b None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:14.291099 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056dd4d-c845-4781-bb31-cabefc5436bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:14.291736 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056dd4d-c845-4781-bb31-cabefc5436bf None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:14.292017 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056dd4d-c845-4781-bb31-cabefc5436bf None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:14.292289 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056dd4d-c845-4781-bb31-cabefc5436bf None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:14.292992 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056dd4d-c845-4781-bb31-cabefc5436bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:14.293293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056dd4d-c845-4781-bb31-cabefc5436bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:14.294696 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056dd4d-c845-4781-bb31-cabefc5436bf None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:14.308509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 464/948] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:14.315318 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce7682-9810-4e9e-9256-04d186876b87 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:14.349174 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:14.422854 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056dd4d-c845-4781-bb31-cabefc5436bf None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:14.442020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce7682-9810-4e9e-9256-04d186876b87 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:14.479546 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02cf36-d964-4023-8ac7-af91081a655d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:14.480179 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02cf36-d964-4023-8ac7-af91081a655d None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:14.480459 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02cf36-d964-4023-8ac7-af91081a655d None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:14.480763 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02cf36-d964-4023-8ac7-af91081a655d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:14.483929 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:14.487863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02cf36-d964-4023-8ac7-af91081a655d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:14.489367 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02cf36-d964-4023-8ac7-af91081a655d None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:14.501234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-3e02cf36-d964-4023-8ac7-af91081a655d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:27:14.501234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:14.501234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:14.501234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:14.501234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:14.501234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:14.501234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:14.501234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:14.501234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:14.501234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:14.501234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:14.501234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:14.501234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:27:14.501234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:27:14.501234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:27:14.505052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:27:14.505052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:14.505052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:14.505052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:14.505052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:14.505052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:14.505052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:14.505052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:14.505052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:14.505052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:14.505052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:14.505052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:14.505052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:14.505052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:14.505052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:14.505052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:14.505052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:14.505997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:27:14.505997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:27:14.505997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:27:14.505997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:27:14.505997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:27:14.505997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:27:14.505997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:27:14.505997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:14.505997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 485/949] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:27:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:27:14.508466 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02cf36-d964-4023-8ac7-af91081a655d None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:14.549860 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056dd4d-c845-4781-bb31-cabefc5436bf None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:14.597469 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f02552-4999-4370-ba0c-34e1b2a89eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:14.598692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f02552-4999-4370-ba0c-34e1b2a89eaf None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:14.599792 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f02552-4999-4370-ba0c-34e1b2a89eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:14.600451 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f02552-4999-4370-ba0c-34e1b2a89eaf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:14.601393 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f02552-4999-4370-ba0c-34e1b2a89eaf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:14.603479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f02552-4999-4370-ba0c-34e1b2a89eaf None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:14.616755 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-98f02552-4999-4370-ba0c-34e1b2a89eaf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 20:27:14.616755 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:14.616755 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:27:14.616755 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:27:14.616755 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:27:14.616755 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:27:14.616755 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:27:14.616755 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:27:14.616755 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 20:27:14.616755 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:14.616755 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:27:14.616755 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:14.616755 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:14.616755 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:14.616755 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:14.616755 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:14.616755 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:14.617835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:14.617835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:14.617835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:14.617835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:14.617835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:14.617835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:14.617835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:27:14.617835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:27:14.617835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:27:14.617835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:27:14.617835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:14.617835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:14.617835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:14.617835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:14.617835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:14.617835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:14.618666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:14.618666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:14.618666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:14.618666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:14.618666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:14.618666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:14.618666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:14.618666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:14.618666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:14.618666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:14.618666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:27:14.618666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:27:14.618666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 20:27:14.618666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:14.626773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02cf36-d964-4023-8ac7-af91081a655d None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:14.626773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:14.627313 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 465/950] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Aug 22 20:27:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:27:14.629349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f02552-4999-4370-ba0c-34e1b2a89eaf None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:14.665868 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370f29c-0244-4570-9189-3b186313c6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:14.666499 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370f29c-0244-4570-9189-3b186313c6be None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:14.666796 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370f29c-0244-4570-9189-3b186313c6be None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:14.667116 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370f29c-0244-4570-9189-3b186313c6be None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:14.667780 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370f29c-0244-4570-9189-3b186313c6be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:14.668085 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370f29c-0244-4570-9189-3b186313c6be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:14.669660 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370f29c-0244-4570-9189-3b186313c6be None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:14.682398 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 486/951] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 22 20:27:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:14.689744 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370f29c-0244-4570-9189-3b186313c6be None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:14.752246 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f02552-4999-4370-ba0c-34e1b2a89eaf None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:14.768604 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:14.802488 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7fbb8-2e39-4c0f-84ef-2f2380ef4ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:14.803790 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7fbb8-2e39-4c0f-84ef-2f2380ef4ffb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:14.804303 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7fbb8-2e39-4c0f-84ef-2f2380ef4ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:14.804837 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7fbb8-2e39-4c0f-84ef-2f2380ef4ffb None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:14.808569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7fbb8-2e39-4c0f-84ef-2f2380ef4ffb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:14.809802 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7fbb8-2e39-4c0f-84ef-2f2380ef4ffb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:14.811537 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7fbb8-2e39-4c0f-84ef-2f2380ef4ffb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:14.819628 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 466/952] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Aug 22 20:27:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:14.825238 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7fbb8-2e39-4c0f-84ef-2f2380ef4ffb None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:14.834584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370f29c-0244-4570-9189-3b186313c6be None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:14.876362 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0368f09-45ac-499f-8dec-75af1aa2da5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:14.877193 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0368f09-45ac-499f-8dec-75af1aa2da5f None admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:14.877475 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0368f09-45ac-499f-8dec-75af1aa2da5f None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:14.877750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0368f09-45ac-499f-8dec-75af1aa2da5f None admin] PATH_INFO: `/v3/projects/783c362712d34405ab827e3f00a67995/users/51ed4c996cde4e88be26544c48200695/roles/0f0fc9106edb4456b2eafeeb4de00cc2` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:14.880047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0368f09-45ac-499f-8dec-75af1aa2da5f None admin] RBAC: Authorizing `identity:create_grant(project_id=783c362712d34405ab827e3f00a67995, user_id=51ed4c996cde4e88be26544c48200695, role_id=0f0fc9106edb4456b2eafeeb4de00cc2)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:14.881501 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0368f09-45ac-499f-8dec-75af1aa2da5f None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:14.944356 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7fbb8-2e39-4c0f-84ef-2f2380ef4ffb None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:14.975736 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 487/953] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 22 20:27:14 2022] PUT /identity/v3/projects/783c362712d34405ab827e3f00a67995/users/51ed4c996cde4e88be26544c48200695/roles/0f0fc9106edb4456b2eafeeb4de00cc2 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:27:14.992445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd50a0-e94a-4f66-bfdf-23e0bfde71b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:14.993638 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd50a0-e94a-4f66-bfdf-23e0bfde71b8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:14.994142 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd50a0-e94a-4f66-bfdf-23e0bfde71b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:14.994612 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd50a0-e94a-4f66-bfdf-23e0bfde71b8 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:14.995628 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd50a0-e94a-4f66-bfdf-23e0bfde71b8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:14.996154 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd50a0-e94a-4f66-bfdf-23e0bfde71b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:14.998001 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd50a0-e94a-4f66-bfdf-23e0bfde71b8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:15.004823 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 467/954] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Aug 22 20:27:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:15.016776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0368f09-45ac-499f-8dec-75af1aa2da5f None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:15.023185 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:15.134115 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0368f09-45ac-499f-8dec-75af1aa2da5f None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:15.173154 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6ecf0-9843-4f2d-9332-ec7168f59895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:15.173804 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6ecf0-9843-4f2d-9332-ec7168f59895 None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:15.174032 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6ecf0-9843-4f2d-9332-ec7168f59895 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:15.174282 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6ecf0-9843-4f2d-9332-ec7168f59895 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:15.174955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6ecf0-9843-4f2d-9332-ec7168f59895 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:15.176383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6ecf0-9843-4f2d-9332-ec7168f59895 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:15.259722 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 488/955] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 22 20:27:15 2022] POST /identity/v3/endpoints => generated 349 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:27:15.494155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2702387-69ed-43f4-8808-047a86d18388 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:15.494700 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2702387-69ed-43f4-8808-047a86d18388 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:15.494700 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2702387-69ed-43f4-8808-047a86d18388 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:15.496126 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 468/956] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:15.502065 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c3bc2-697a-4576-b25f-b1a675339b2d None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:15.502347 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c3bc2-697a-4576-b25f-b1a675339b2d None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:15.502619 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c3bc2-697a-4576-b25f-b1a675339b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:15.523648 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-741c3bc2-697a-4576-b25f-b1a675339b2d None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:15.525504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-741c3bc2-697a-4576-b25f-b1a675339b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:15.586840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:15.601378 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 489/957] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:27:15.881237 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2702387-69ed-43f4-8808-047a86d18388 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:15.926236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:15.986605 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2702387-69ed-43f4-8808-047a86d18388 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:16.020438 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12279b98-99d4-4687-8b4f-15927511822d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:16.021095 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12279b98-99d4-4687-8b4f-15927511822d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:16.021368 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12279b98-99d4-4687-8b4f-15927511822d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:16.021635 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12279b98-99d4-4687-8b4f-15927511822d None admin] PATH_INFO: `/v3/services/compute` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:16.022208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12279b98-99d4-4687-8b4f-15927511822d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:16.023570 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12279b98-99d4-4687-8b4f-15927511822d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:16.032949 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-12279b98-99d4-4687-8b4f-15927511822d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 20:27:16.032949 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:16.032949 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:27:16.032949 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:27:16.032949 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:27:16.032949 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:27:16.032949 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:27:16.032949 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:27:16.032949 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 20:27:16.032949 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:16.032949 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:27:16.032949 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:16.032949 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:16.032949 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:16.032949 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:16.032949 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:16.032949 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:16.034127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:16.034127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:16.034127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:16.034127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:16.034127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:16.034127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:16.034127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:27:16.034127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:27:16.034127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:27:16.034127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:27:16.034127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:16.034127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:16.034127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:16.034127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:16.034127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:16.034127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:16.035618 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:16.035618 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:16.035618 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:16.035618 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:16.035618 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:16.035618 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:16.035618 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:16.035618 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:16.035618 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:16.035618 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:16.035618 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:27:16.035618 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:27:16.035618 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 20:27:16.035618 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:16.035618 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 469/958] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:27:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:16.040305 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c3bc2-697a-4576-b25f-b1a675339b2d None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:16.145480 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c3bc2-697a-4576-b25f-b1a675339b2d None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:16.183733 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db97af-faa4-487e-a37a-0516bdddef0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:16.184409 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db97af-faa4-487e-a37a-0516bdddef0f None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:16.184623 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db97af-faa4-487e-a37a-0516bdddef0f None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:16.184919 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db97af-faa4-487e-a37a-0516bdddef0f None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:16.185563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db97af-faa4-487e-a37a-0516bdddef0f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:16.185872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db97af-faa4-487e-a37a-0516bdddef0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:16.187356 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db97af-faa4-487e-a37a-0516bdddef0f None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:16.192819 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 490/959] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Aug 22 20:27:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:16.198019 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12279b98-99d4-4687-8b4f-15927511822d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:16.290008 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4aa011-8320-4f80-8d44-f18080a453ec None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:16.290342 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4aa011-8320-4f80-8d44-f18080a453ec None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:16.290552 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4aa011-8320-4f80-8d44-f18080a453ec None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:16.293180 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 491/960] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:27:16.304779 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12279b98-99d4-4687-8b4f-15927511822d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:16.305682 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e428fc-6d33-4b3b-a134-6e61b84ca582 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:16.305976 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e428fc-6d33-4b3b-a134-6e61b84ca582 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:16.306252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e428fc-6d33-4b3b-a134-6e61b84ca582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:16.309189 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:16.326132 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-b0e428fc-6d33-4b3b-a134-6e61b84ca582 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:16.348983 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b0e428fc-6d33-4b3b-a134-6e61b84ca582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:16.349131 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03412c-80e3-4e44-a267-c9abd3578934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:16.349131 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03412c-80e3-4e44-a267-c9abd3578934 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:16.349131 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03412c-80e3-4e44-a267-c9abd3578934 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:16.349131 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03412c-80e3-4e44-a267-c9abd3578934 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:16.349449 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03412c-80e3-4e44-a267-c9abd3578934 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:16.349449 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03412c-80e3-4e44-a267-c9abd3578934 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:16.349449 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03412c-80e3-4e44-a267-c9abd3578934 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:16.350671 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 470/961] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Aug 22 20:27:16 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:16.393041 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:16.409823 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 492/962] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:27:16.686773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03412c-80e3-4e44-a267-c9abd3578934 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:16.792908 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03412c-80e3-4e44-a267-c9abd3578934 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:16.831771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72f191-0c09-41f6-b1e1-bc0645003c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:16.832438 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72f191-0c09-41f6-b1e1-bc0645003c1a None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:16.832734 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72f191-0c09-41f6-b1e1-bc0645003c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:16.833008 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72f191-0c09-41f6-b1e1-bc0645003c1a None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:16.833705 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f72f191-0c09-41f6-b1e1-bc0645003c1a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:16.835144 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f72f191-0c09-41f6-b1e1-bc0645003c1a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:16.837709 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: WARNING keystone.server.flask.common [None req-7f72f191-0c09-41f6-b1e1-bc0645003c1a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 22 20:27:16.886452 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.sql.core [None req-7f72f191-0c09-41f6-b1e1-bc0645003c1a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 22 20:27:16.886452 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 22 20:27:16.886452 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [parameters: {'user_id': 'c7391862e54e47c89bdc7bd6441f2df6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 22 20:27:16.886452 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81638) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 22 20:27:16.893292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-7f72f191-0c09-41f6-b1e1-bc0645003c1a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 22 20:27:16.893292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:16.893292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 20:27:16.893292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 20:27:16.893292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 20:27:16.893292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 20:27:16.893292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 20:27:16.893292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 20:27:16.893292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 20:27:16.893292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application conn.query(q) Aug 22 20:27:16.893292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 20:27:16.893292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 20:27:16.893292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 20:27:16.893292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application result.read() Aug 22 20:27:16.893292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 20:27:16.898568 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 20:27:16.898568 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 20:27:16.898568 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 20:27:16.898568 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 20:27:16.898568 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 20:27:16.898568 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 20:27:16.898568 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 20:27:16.898568 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 22 20:27:16.898568 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:16.898568 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 22 20:27:16.898568 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:16.898568 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:16.898568 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 22 20:27:16.898568 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 22 20:27:16.898568 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 22 20:27:16.898568 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 22 20:27:16.898568 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 20:27:16.898568 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application next(self.gen) Aug 22 20:27:16.899600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 22 20:27:16.899600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application yield resource Aug 22 20:27:16.899600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 20:27:16.899600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application next(self.gen) Aug 22 20:27:16.899600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 22 20:27:16.899600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self.session.rollback() Aug 22 20:27:16.899600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 20:27:16.899600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self.force_reraise() Aug 22 20:27:16.899600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 20:27:16.899600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise self.value Aug 22 20:27:16.899600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 22 20:27:16.899600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 22 20:27:16.899600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 22 20:27:16.899600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application session.commit() Aug 22 20:27:16.899600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 22 20:27:16.899600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 22 20:27:16.899600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 22 20:27:16.900513 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._prepare_impl() Aug 22 20:27:16.900513 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 22 20:27:16.900513 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self.session.flush() Aug 22 20:27:16.900513 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 22 20:27:16.900513 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._flush(objects) Aug 22 20:27:16.900513 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 22 20:27:16.900513 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 22 20:27:16.900513 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 22 20:27:16.900513 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application compat.raise_( Aug 22 20:27:16.900513 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 20:27:16.900513 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception Aug 22 20:27:16.900513 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 22 20:27:16.900513 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application flush_context.execute() Aug 22 20:27:16.900513 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 22 20:27:16.900513 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rec.execute(self) Aug 22 20:27:16.900513 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 22 20:27:16.900513 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 22 20:27:16.901468 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 22 20:27:16.901468 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 22 20:27:16.901468 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 22 20:27:16.901468 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 22 20:27:16.901468 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 22 20:27:16.901468 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 22 20:27:16.901468 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 22 20:27:16.901468 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 22 20:27:16.901468 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 22 20:27:16.901468 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 22 20:27:16.901468 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 22 20:27:16.901468 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 22 20:27:16.901468 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 22 20:27:16.901468 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 22 20:27:16.901468 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 20:27:16.901468 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception Aug 22 20:27:16.902357 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 20:27:16.902357 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 20:27:16.902357 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 20:27:16.902357 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 20:27:16.902357 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 20:27:16.902357 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 20:27:16.902357 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 20:27:16.902357 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application conn.query(q) Aug 22 20:27:16.902357 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 20:27:16.902357 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 20:27:16.902357 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 20:27:16.902357 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application result.read() Aug 22 20:27:16.902357 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 20:27:16.902357 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 20:27:16.902357 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 20:27:16.902357 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 20:27:16.903263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 20:27:16.903263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 20:27:16.903263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 20:27:16.903263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 20:27:16.903263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 22 20:27:16.903263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 22 20:27:16.903263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c7391862e54e47c89bdc7bd6441f2df6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 22 20:27:16.903263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 22 20:27:16.903263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:16.903263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:27:16.903263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:16.903263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:16.903263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:16.903263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:16.903263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:16.904057 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:16.904057 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:16.904057 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:16.904057 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:16.904057 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:16.904057 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:16.904057 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:16.904057 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 22 20:27:16.904057 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 22 20:27:16.904057 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:16.904057 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:16.904057 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:27:16.904057 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:27:16.904057 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:27:16.904057 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:27:16.904057 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 22 20:27:16.904057 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 22 20:27:16.906996 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 22 20:27:16.906996 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 22 20:27:16.906996 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 22 20:27:16.906996 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 22 20:27:16.906996 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 22 20:27:16.906996 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:16.906996 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 471/963] 10.222.0.62 () {60 vars in 1131 bytes} [Mon Aug 22 20:27:16 2022] POST /identity/v3/users => generated 160 bytes in 208 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:16.907999 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e428fc-6d33-4b3b-a134-6e61b84ca582 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:17.015791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e428fc-6d33-4b3b-a134-6e61b84ca582 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:17.052016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed159831-d6dc-47f8-841a-25887b25b41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:17.052650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed159831-d6dc-47f8-841a-25887b25b41a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:17.052958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed159831-d6dc-47f8-841a-25887b25b41a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:17.053233 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed159831-d6dc-47f8-841a-25887b25b41a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:17.060574 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed159831-d6dc-47f8-841a-25887b25b41a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:17.062044 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed159831-d6dc-47f8-841a-25887b25b41a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:17.073800 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a760ff-3b90-4394-9a90-decca15c5b30 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:17.074380 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a760ff-3b90-4394-9a90-decca15c5b30 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:17.074663 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a760ff-3b90-4394-9a90-decca15c5b30 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:17.074902 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-ed159831-d6dc-47f8-841a-25887b25b41a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 20:27:17.074902 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:17.074902 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:17.074902 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:17.074902 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:17.074902 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:17.074902 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:17.074902 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:17.074902 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:17.074902 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:17.074902 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:17.074902 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:17.074902 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:27:17.074902 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:27:17.074902 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:27:17.074902 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:27:17.077025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:17.077025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:17.077025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:27:17.077025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:27:17.077025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:27:17.077025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:27:17.077025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:17.077025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:17.077025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:17.077025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:17.077025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:17.077025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:17.077025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:17.077025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:17.077025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:17.077025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:17.077025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:17.077025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:17.078786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:17.078786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:17.078786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:27:17.078786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:27:17.078786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:27:17.078786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:27:17.078786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:27:17.078786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:27:17.078786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 20:27:17.078786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:17.078786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 493/964] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:27:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:17.088681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 472/965] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:17 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:17.088939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed159831-d6dc-47f8-841a-25887b25b41a None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:17.089341 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656e7c4-41cc-45a0-975c-bf8c1e6ffd9e None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:17.089626 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656e7c4-41cc-45a0-975c-bf8c1e6ffd9e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:17.089899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656e7c4-41cc-45a0-975c-bf8c1e6ffd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:17.109637 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-f656e7c4-41cc-45a0-975c-bf8c1e6ffd9e None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:17.112188 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f656e7c4-41cc-45a0-975c-bf8c1e6ffd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:17.135385 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:17.137293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:17.193103 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 473/966] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:27:17.193573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed159831-d6dc-47f8-841a-25887b25b41a None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:17.229600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4e0f4-14e8-41fb-8231-19f729c01530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:17.230208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4e0f4-14e8-41fb-8231-19f729c01530 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:17.230491 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4e0f4-14e8-41fb-8231-19f729c01530 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:17.230763 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4e0f4-14e8-41fb-8231-19f729c01530 None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:17.231459 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4e0f4-14e8-41fb-8231-19f729c01530 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:17.231760 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4e0f4-14e8-41fb-8231-19f729c01530 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:17.233229 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4e0f4-14e8-41fb-8231-19f729c01530 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:17.269805 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 494/967] 10.222.0.62 () {56 vars in 1101 bytes} [Mon Aug 22 20:27:17 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:17.347469 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc772649-9f64-45ed-84ca-e9e51ec9559b None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:17.347995 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc772649-9f64-45ed-84ca-e9e51ec9559b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:17.348331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc772649-9f64-45ed-84ca-e9e51ec9559b None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:17.350102 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 474/968] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:17.359099 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadc69d-df3a-4948-a7f1-371f7cf83530 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:17.359099 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadc69d-df3a-4948-a7f1-371f7cf83530 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:17.359099 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadc69d-df3a-4948-a7f1-371f7cf83530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:17.377118 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-dfadc69d-df3a-4948-a7f1-371f7cf83530 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:17.378581 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-dfadc69d-df3a-4948-a7f1-371f7cf83530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:17.454860 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 495/969] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:27:17.496754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc772649-9f64-45ed-84ca-e9e51ec9559b None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:17.606432 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc772649-9f64-45ed-84ca-e9e51ec9559b None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:17.640528 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da34fd-6803-4710-91ab-a6433430cb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:17.641688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da34fd-6803-4710-91ab-a6433430cb35 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:17.642065 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da34fd-6803-4710-91ab-a6433430cb35 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:17.642342 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da34fd-6803-4710-91ab-a6433430cb35 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:17.652381 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da34fd-6803-4710-91ab-a6433430cb35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:27:17.657835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-b5da34fd-6803-4710-91ab-a6433430cb35 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 20:27:17.657835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:17.657835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:17.657835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:17.657835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:17.657835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:17.657835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:17.657835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:17.657835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:17.657835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:17.657835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:17.657835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:17.657835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:27:17.657835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:27:17.657835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:27:17.657835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:27:17.658821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:27:17.658821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:27:17.658821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:27:17.658821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:27:17.658821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:17.658821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:17.658821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:17.658821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:17.658821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:17.658821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:17.658821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:17.658821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:17.658821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:17.658821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:17.658821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:17.658821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:17.660063 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:17.660063 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:17.660063 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:17.660063 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:17.660063 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:27:17.660063 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:27:17.660063 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:27:17.660063 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:27:17.660063 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:27:17.660063 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:27:17.660063 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 20:27:17.660063 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:17.663825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 475/970] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Aug 22 20:27:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:17.665091 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadc69d-df3a-4948-a7f1-371f7cf83530 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:17.696923 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:17.738472 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da34fd-6803-4710-91ab-a6433430cb35 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:17.763400 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:17.773055 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadc69d-df3a-4948-a7f1-371f7cf83530 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:17.818062 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd84df-39f5-4a9b-855d-a0c2a337234f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:17.818666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd84df-39f5-4a9b-855d-a0c2a337234f None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:17.818948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd84df-39f5-4a9b-855d-a0c2a337234f None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:17.819220 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd84df-39f5-4a9b-855d-a0c2a337234f None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:17.819882 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd84df-39f5-4a9b-855d-a0c2a337234f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:17.820178 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd84df-39f5-4a9b-855d-a0c2a337234f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:17.821573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd84df-39f5-4a9b-855d-a0c2a337234f None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:17.831541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 496/971] 10.222.0.62 () {56 vars in 1115 bytes} [Mon Aug 22 20:27:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:17.836959 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd84df-39f5-4a9b-855d-a0c2a337234f None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:17.853776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da34fd-6803-4710-91ab-a6433430cb35 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:17.896453 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e13336-e64a-45fd-8115-e4d6df7e5807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:17.897439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e13336-e64a-45fd-8115-e4d6df7e5807 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:17.897982 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e13336-e64a-45fd-8115-e4d6df7e5807 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:17.898272 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e13336-e64a-45fd-8115-e4d6df7e5807 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:17.898865 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e13336-e64a-45fd-8115-e4d6df7e5807 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:17.901150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e13336-e64a-45fd-8115-e4d6df7e5807 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:17.911603 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-21e13336-e64a-45fd-8115-e4d6df7e5807 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 20:27:17.911603 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:17.911603 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:27:17.911603 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:27:17.911603 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:27:17.911603 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:27:17.911603 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:27:17.911603 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:27:17.911603 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 20:27:17.911603 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:17.911603 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:27:17.911603 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:17.911603 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:17.911603 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:17.911603 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:17.911603 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:17.911603 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:17.912615 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:17.912615 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:17.912615 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:17.912615 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:17.912615 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:17.912615 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:17.912615 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:27:17.912615 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:27:17.912615 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:27:17.912615 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:27:17.912615 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:17.912615 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:17.912615 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:17.912615 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:17.912615 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:17.912615 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:17.913497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:17.913497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:17.913497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:17.913497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:17.913497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:17.913497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:17.913497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:17.913497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:17.913497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:17.913497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:17.913497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:27:17.913497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:27:17.913497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 20:27:17.913497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:17.913497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 476/972] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Aug 22 20:27:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:27:17.918623 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e13336-e64a-45fd-8115-e4d6df7e5807 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:17.941399 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:17.948391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd84df-39f5-4a9b-855d-a0c2a337234f None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:17.985709 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed1ef5-285f-41ab-b2f8-cd03b6057851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:17.986456 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed1ef5-285f-41ab-b2f8-cd03b6057851 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:17.986735 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed1ef5-285f-41ab-b2f8-cd03b6057851 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:17.987026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed1ef5-285f-41ab-b2f8-cd03b6057851 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:17.997667 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed1ef5-285f-41ab-b2f8-cd03b6057851 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:17.999114 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed1ef5-285f-41ab-b2f8-cd03b6057851 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:18.009961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:18.018759 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-11ed1ef5-285f-41ab-b2f8-cd03b6057851 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:18.018759 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:18.018759 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:18.018759 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:18.018759 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:18.018759 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:18.018759 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:18.018759 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:18.018759 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:18.018759 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:18.018759 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:18.018759 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:18.018759 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:27:18.018759 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:27:18.018759 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:27:18.018759 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:27:18.023182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:18.023182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:18.023182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:18.023182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:18.023182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:18.023182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:18.023182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:18.023182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:18.023182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:18.023182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:18.023182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:18.023182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:18.023182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:18.023182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:18.023182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:18.023182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:18.023182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:27:18.024103 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:27:18.024103 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:18.024103 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:18.024103 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 497/973] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:27:18.025619 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed1ef5-285f-41ab-b2f8-cd03b6057851 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:18.030849 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e13336-e64a-45fd-8115-e4d6df7e5807 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:18.072520 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f0842-c574-4482-9fef-197c953ce65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:18.073169 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f0842-c574-4482-9fef-197c953ce65f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:18.073450 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f0842-c574-4482-9fef-197c953ce65f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:18.073733 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f0842-c574-4482-9fef-197c953ce65f None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:18.074607 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f0842-c574-4482-9fef-197c953ce65f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:18.074910 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f0842-c574-4482-9fef-197c953ce65f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:18.076280 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f0842-c574-4482-9fef-197c953ce65f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:18.087000 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 477/974] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Aug 22 20:27:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:18.087689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f0842-c574-4482-9fef-197c953ce65f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:18.132571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed1ef5-285f-41ab-b2f8-cd03b6057851 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:18.168328 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50aa56-e1bb-4714-a0d1-37b2bd4bc26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:18.168883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50aa56-e1bb-4714-a0d1-37b2bd4bc26d None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:18.169165 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50aa56-e1bb-4714-a0d1-37b2bd4bc26d None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:18.169436 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a50aa56-e1bb-4714-a0d1-37b2bd4bc26d None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:18.170199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a50aa56-e1bb-4714-a0d1-37b2bd4bc26d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:18.170502 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a50aa56-e1bb-4714-a0d1-37b2bd4bc26d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:18.172568 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a50aa56-e1bb-4714-a0d1-37b2bd4bc26d None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:18.185968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 498/975] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:18.192215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50aa56-e1bb-4714-a0d1-37b2bd4bc26d None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:18.194543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f0842-c574-4482-9fef-197c953ce65f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:18.201504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:18.230898 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b370aa-44e4-4d13-9686-29035cf1c3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:18.231512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b370aa-44e4-4d13-9686-29035cf1c3d8 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:18.231795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b370aa-44e4-4d13-9686-29035cf1c3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:18.232069 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b370aa-44e4-4d13-9686-29035cf1c3d8 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:18.232728 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b370aa-44e4-4d13-9686-29035cf1c3d8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:18.233034 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b370aa-44e4-4d13-9686-29035cf1c3d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:18.234923 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b370aa-44e4-4d13-9686-29035cf1c3d8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:18.240164 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 478/976] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Aug 22 20:27:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:18.245733 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b370aa-44e4-4d13-9686-29035cf1c3d8 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:18.261706 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:18.315034 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a50aa56-e1bb-4714-a0d1-37b2bd4bc26d None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:18.349341 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b370aa-44e4-4d13-9686-29035cf1c3d8 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:18.349614 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d90aa-876b-4676-b6c4-d61b13a18c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:18.350262 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d90aa-876b-4676-b6c4-d61b13a18c8f None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:18.350541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d90aa-876b-4676-b6c4-d61b13a18c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:18.350811 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d90aa-876b-4676-b6c4-d61b13a18c8f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:18.357661 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d90aa-876b-4676-b6c4-d61b13a18c8f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:18.359103 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d90aa-876b-4676-b6c4-d61b13a18c8f None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:18.371067 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-e43d90aa-876b-4676-b6c4-d61b13a18c8f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 20:27:18.371067 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:18.371067 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:18.371067 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:18.371067 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:18.371067 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:18.371067 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:18.371067 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:18.371067 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:18.371067 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:18.371067 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:18.371067 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:18.371067 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:27:18.371067 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:27:18.371067 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:27:18.371067 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:27:18.372028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:18.372028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:18.372028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:27:18.372028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:27:18.372028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:27:18.372028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:27:18.372028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:18.372028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:18.372028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:18.372028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:18.372028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:18.372028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:18.372028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:18.372028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:18.372028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:18.372028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:18.372028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:18.372028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:18.373002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:18.373002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:18.373002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:27:18.373002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:27:18.373002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:27:18.373002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:27:18.373002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:27:18.373002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:27:18.373002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 20:27:18.373002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:18.373002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 499/977] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Aug 22 20:27:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:27:18.373649 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b3e8c-defb-45cd-b20e-fa591df9c040 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:18.373649 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b3e8c-defb-45cd-b20e-fa591df9c040 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:18.373773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b3e8c-defb-45cd-b20e-fa591df9c040 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:18.374994 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 500/978] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:18.378727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b3e8c-defb-45cd-b20e-fa591df9c040 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:18.390390 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b572c4-abe0-4f4b-9b27-ac4117929fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:18.391773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b572c4-abe0-4f4b-9b27-ac4117929fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:18.392313 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b572c4-abe0-4f4b-9b27-ac4117929fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:18.392794 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b572c4-abe0-4f4b-9b27-ac4117929fb3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:18.394082 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b572c4-abe0-4f4b-9b27-ac4117929fb3 None admin] RBAC: Adding query filter params (interface=admin, service_id=9eff7fb171454a5e83e756be97bee974, region_id=RegionOne) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:18.394502 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b572c4-abe0-4f4b-9b27-ac4117929fb3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:18.395938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b572c4-abe0-4f4b-9b27-ac4117929fb3 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:18.401039 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 479/979] 10.222.0.62 () {56 vars in 1249 bytes} [Mon Aug 22 20:27:18 2022] GET /identity/v3/endpoints?service_id=9eff7fb171454a5e83e756be97bee974&interface=admin®ion_id=RegionOne => generated 193 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:18.402250 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae8acc-41f6-4a29-83ec-e8428d9fa765 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:18.402534 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae8acc-41f6-4a29-83ec-e8428d9fa765 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:18.402806 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae8acc-41f6-4a29-83ec-e8428d9fa765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:18.420867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-30ae8acc-41f6-4a29-83ec-e8428d9fa765 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:18.422513 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-30ae8acc-41f6-4a29-83ec-e8428d9fa765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:18.445385 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:18.483102 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b3e8c-defb-45cd-b20e-fa591df9c040 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:18.495101 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 480/980] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:27:18.496024 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae8acc-41f6-4a29-83ec-e8428d9fa765 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:18.504389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:18.524684 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2686ea-2330-4061-865d-eced0c7dfa80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:18.528058 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2686ea-2330-4061-865d-eced0c7dfa80 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:18.528058 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2686ea-2330-4061-865d-eced0c7dfa80 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:18.528058 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2686ea-2330-4061-865d-eced0c7dfa80 None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:18.528058 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2686ea-2330-4061-865d-eced0c7dfa80 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:18.528058 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2686ea-2330-4061-865d-eced0c7dfa80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:18.528416 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2686ea-2330-4061-865d-eced0c7dfa80 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:18.546861 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 501/981] 10.222.0.62 () {56 vars in 1149 bytes} [Mon Aug 22 20:27:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:18.553253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2686ea-2330-4061-865d-eced0c7dfa80 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:18.598529 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae8acc-41f6-4a29-83ec-e8428d9fa765 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:18.632880 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533bfdb-0301-4759-ae62-e91e300837ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:18.633590 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533bfdb-0301-4759-ae62-e91e300837ea None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:18.633933 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533bfdb-0301-4759-ae62-e91e300837ea None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:18.634139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533bfdb-0301-4759-ae62-e91e300837ea None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:18.634730 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533bfdb-0301-4759-ae62-e91e300837ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:18.636094 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533bfdb-0301-4759-ae62-e91e300837ea None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:18.643076 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 481/982] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Aug 22 20:27:18 2022] GET /identity/v3/services => generated 1497 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:27:18.660025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2686ea-2330-4061-865d-eced0c7dfa80 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:18.687025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:18.699341 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24265d90-5153-4aaa-ade8-8c0797127f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:18.699964 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24265d90-5153-4aaa-ade8-8c0797127f17 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:18.700237 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24265d90-5153-4aaa-ade8-8c0797127f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:18.700503 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24265d90-5153-4aaa-ade8-8c0797127f17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:18.772440 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533bfdb-0301-4759-ae62-e91e300837ea None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:18.776906 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24265d90-5153-4aaa-ade8-8c0797127f17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:18.778440 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24265d90-5153-4aaa-ade8-8c0797127f17 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:18.857634 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:18.892032 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533bfdb-0301-4759-ae62-e91e300837ea None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:18.898519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 502/983] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:27:18 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 20:27:18.904117 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24265d90-5153-4aaa-ade8-8c0797127f17 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:18.928043 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fdc37f-fdde-4ce3-8c9f-6c522fcfb407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:18.928685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdc37f-fdde-4ce3-8c9f-6c522fcfb407 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:18.928805 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:18.928969 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdc37f-fdde-4ce3-8c9f-6c522fcfb407 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:18.929242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdc37f-fdde-4ce3-8c9f-6c522fcfb407 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:18.929926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fdc37f-fdde-4ce3-8c9f-6c522fcfb407 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:18.931279 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fdc37f-fdde-4ce3-8c9f-6c522fcfb407 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:19.004491 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 482/984] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Aug 22 20:27:18 2022] POST /identity/v3/services => generated 242 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:27:19.007124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24265d90-5153-4aaa-ade8-8c0797127f17 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:19.054561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f624b-01b2-47f7-afce-1c9ff644b939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:19.055233 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f624b-01b2-47f7-afce-1c9ff644b939 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:19.055508 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f624b-01b2-47f7-afce-1c9ff644b939 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:19.055771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f624b-01b2-47f7-afce-1c9ff644b939 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:19.067457 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f624b-01b2-47f7-afce-1c9ff644b939 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:19.068976 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f624b-01b2-47f7-afce-1c9ff644b939 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:19.085709 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-fc0f624b-01b2-47f7-afce-1c9ff644b939 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:19.085709 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:19.085709 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:19.085709 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:19.085709 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:19.085709 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:19.085709 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:19.085709 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:19.085709 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:19.085709 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:19.085709 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:19.085709 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:19.085709 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:27:19.085709 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:27:19.085709 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:27:19.085709 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:27:19.086754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:19.086754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:19.086754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:19.086754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:19.086754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:19.086754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:19.086754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:19.086754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:19.086754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:19.086754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:19.086754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:19.086754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:19.086754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:19.086754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:19.086754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:19.086754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:19.086754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:27:19.087629 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:27:19.087629 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:19.087629 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:19.089004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 503/985] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:27:19.092793 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fdc37f-fdde-4ce3-8c9f-6c522fcfb407 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:19.206702 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fdc37f-fdde-4ce3-8c9f-6c522fcfb407 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:19.237693 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:19.243369 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26619cb8-f2df-453d-84c3-65889dea4819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:19.243974 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26619cb8-f2df-453d-84c3-65889dea4819 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:19.244253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26619cb8-f2df-453d-84c3-65889dea4819 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:19.244523 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26619cb8-f2df-453d-84c3-65889dea4819 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:19.245204 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26619cb8-f2df-453d-84c3-65889dea4819 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:19.245499 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26619cb8-f2df-453d-84c3-65889dea4819 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:19.246865 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26619cb8-f2df-453d-84c3-65889dea4819 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:19.260143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 483/986] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:19.266317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f624b-01b2-47f7-afce-1c9ff644b939 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:19.340746 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:19.372062 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f624b-01b2-47f7-afce-1c9ff644b939 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:19.405742 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b909f7-e0f5-4f3e-8a0a-5b19fe8056c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:19.407351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b909f7-e0f5-4f3e-8a0a-5b19fe8056c4 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:19.407351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b909f7-e0f5-4f3e-8a0a-5b19fe8056c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:19.407698 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b909f7-e0f5-4f3e-8a0a-5b19fe8056c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:19.414472 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b909f7-e0f5-4f3e-8a0a-5b19fe8056c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:19.415914 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b909f7-e0f5-4f3e-8a0a-5b19fe8056c4 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:19.427656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-89b909f7-e0f5-4f3e-8a0a-5b19fe8056c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:27:19.427656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:19.427656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:19.427656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:19.427656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:19.427656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:19.427656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:19.427656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:19.427656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:19.427656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:19.427656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:19.427656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:19.427656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:27:19.427656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:27:19.427656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:27:19.428531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:27:19.428531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:19.428531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:19.428531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:19.428531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:19.428531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:19.428531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:19.428531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:19.428531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:19.428531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:19.428531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:19.428531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:19.428531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:19.428531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:19.428531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:19.428531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:19.428531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:19.429525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:27:19.429525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:27:19.429525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:27:19.429525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:27:19.429525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:27:19.429525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:27:19.429525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:27:19.429525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:19.432727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 504/987] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:27:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:19.434565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26619cb8-f2df-453d-84c3-65889dea4819 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:19.539643 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26619cb8-f2df-453d-84c3-65889dea4819 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:19.585796 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f98a39-fedb-4ba2-b6b9-5bb9318eb4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:19.590277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f98a39-fedb-4ba2-b6b9-5bb9318eb4f9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:19.590277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f98a39-fedb-4ba2-b6b9-5bb9318eb4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:19.590277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f98a39-fedb-4ba2-b6b9-5bb9318eb4f9 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:19.590277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f98a39-fedb-4ba2-b6b9-5bb9318eb4f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:19.590277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f98a39-fedb-4ba2-b6b9-5bb9318eb4f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:19.590277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f98a39-fedb-4ba2-b6b9-5bb9318eb4f9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:19.606435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 484/988] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 22 20:27:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:19.608311 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b909f7-e0f5-4f3e-8a0a-5b19fe8056c4 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:19.711352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b909f7-e0f5-4f3e-8a0a-5b19fe8056c4 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:19.741745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:19.747312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3eab44-13b7-4186-a2e3-5e860424c079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:19.748004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3eab44-13b7-4186-a2e3-5e860424c079 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:19.748276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3eab44-13b7-4186-a2e3-5e860424c079 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:19.748546 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3eab44-13b7-4186-a2e3-5e860424c079 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:19.749291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3eab44-13b7-4186-a2e3-5e860424c079 None admin] RBAC: Adding query filter params (role.id=0f0fc9106edb4456b2eafeeb4de00cc2, scope.project.id=783c362712d34405ab827e3f00a67995, user.id=51ed4c996cde4e88be26544c48200695) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:19.749595 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3eab44-13b7-4186-a2e3-5e860424c079 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:19.751633 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3eab44-13b7-4186-a2e3-5e860424c079 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:19.758076 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 505/989] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:27:19 2022] GET /identity/v3/role_assignments?user.id=51ed4c996cde4e88be26544c48200695&scope.project.id=783c362712d34405ab827e3f00a67995&role.id=0f0fc9106edb4456b2eafeeb4de00cc2 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:20.565061 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df66ab-94f8-4d81-a45c-6037a88b6227 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:20.565606 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df66ab-94f8-4d81-a45c-6037a88b6227 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:20.565606 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df66ab-94f8-4d81-a45c-6037a88b6227 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:20.566938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 485/990] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:20.572581 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a3339-6eee-4ac9-aedd-7256876aacd4 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:20.573056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a3339-6eee-4ac9-aedd-7256876aacd4 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:20.573249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a3339-6eee-4ac9-aedd-7256876aacd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:20.595730 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-5b0a3339-6eee-4ac9-aedd-7256876aacd4 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:20.596956 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-5b0a3339-6eee-4ac9-aedd-7256876aacd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:20.665318 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 506/991] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:20 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:27:20.930438 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df66ab-94f8-4d81-a45c-6037a88b6227 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:20.982132 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18639690-5e10-4f89-9bd4-3299c35f41d1 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:20.982481 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18639690-5e10-4f89-9bd4-3299c35f41d1 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:20.982679 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18639690-5e10-4f89-9bd4-3299c35f41d1 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:20.983140 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:20.984008 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 507/992] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:27:20.989433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd376c93-8cf7-444e-915a-6ac70cab6199 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:20.989717 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd376c93-8cf7-444e-915a-6ac70cab6199 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:20.989989 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd376c93-8cf7-444e-915a-6ac70cab6199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:21.008184 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-fd376c93-8cf7-444e-915a-6ac70cab6199 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:21.009401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-fd376c93-8cf7-444e-915a-6ac70cab6199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:21.041793 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df66ab-94f8-4d81-a45c-6037a88b6227 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:21.079755 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad406aaa-7b2d-4adf-8ff7-ab6f8f0458ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:21.080384 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad406aaa-7b2d-4adf-8ff7-ab6f8f0458ad None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:21.080668 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad406aaa-7b2d-4adf-8ff7-ab6f8f0458ad None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:21.080971 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad406aaa-7b2d-4adf-8ff7-ab6f8f0458ad None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:21.081549 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad406aaa-7b2d-4adf-8ff7-ab6f8f0458ad None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:21.082322 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 508/993] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:20 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:27:21.082923 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad406aaa-7b2d-4adf-8ff7-ab6f8f0458ad None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:21.091752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-ad406aaa-7b2d-4adf-8ff7-ab6f8f0458ad None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 20:27:21.091752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:21.091752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:27:21.091752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:27:21.091752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:27:21.091752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:27:21.091752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:27:21.091752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:27:21.091752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 20:27:21.091752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:21.091752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:27:21.091752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:21.091752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:21.091752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:21.091752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:21.091752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:21.091752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:21.093032 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:21.093032 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:21.093032 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:21.093032 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:21.093032 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:21.093032 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:21.093032 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:27:21.093032 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:27:21.093032 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:27:21.093032 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:27:21.093032 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:21.093032 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:21.093032 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:21.093032 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:21.093032 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:21.093032 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:21.094027 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:21.094027 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:21.094027 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:21.094027 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:21.094027 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:21.094027 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:21.094027 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:21.094027 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:21.094027 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:21.094027 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:21.094027 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:27:21.094027 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:27:21.094027 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 20:27:21.094027 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:21.094027 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 486/994] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Aug 22 20:27:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:21.100697 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd376c93-8cf7-444e-915a-6ac70cab6199 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:21.158578 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:21.202449 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd376c93-8cf7-444e-915a-6ac70cab6199 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:21.236269 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb04a1-a125-46d2-960f-08ab337be189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:21.236909 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb04a1-a125-46d2-960f-08ab337be189 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:21.237186 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb04a1-a125-46d2-960f-08ab337be189 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:21.237455 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb04a1-a125-46d2-960f-08ab337be189 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:21.238083 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb04a1-a125-46d2-960f-08ab337be189 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:21.238381 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb04a1-a125-46d2-960f-08ab337be189 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:21.239741 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb04a1-a125-46d2-960f-08ab337be189 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:21.244643 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 509/995] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Aug 22 20:27:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:21.250785 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad406aaa-7b2d-4adf-8ff7-ab6f8f0458ad None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:21.355117 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad406aaa-7b2d-4adf-8ff7-ab6f8f0458ad None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:21.358715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb04a1-a125-46d2-960f-08ab337be189 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:21.371263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:21.395977 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbb47e-2de0-43fb-95d1-db59a05ab1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:21.397424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbb47e-2de0-43fb-95d1-db59a05ab1ad None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:21.397722 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbb47e-2de0-43fb-95d1-db59a05ab1ad None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:21.398001 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbb47e-2de0-43fb-95d1-db59a05ab1ad None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:21.398640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbb47e-2de0-43fb-95d1-db59a05ab1ad None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:21.398955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbb47e-2de0-43fb-95d1-db59a05ab1ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:21.400343 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbb47e-2de0-43fb-95d1-db59a05ab1ad None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:21.411610 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 487/996] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Aug 22 20:27:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:21.412811 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbb47e-2de0-43fb-95d1-db59a05ab1ad None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:21.470194 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb04a1-a125-46d2-960f-08ab337be189 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:21.493122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:21.508039 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03ed59-3996-4a7b-bcb3-18a4c5917d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:21.508725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03ed59-3996-4a7b-bcb3-18a4c5917d21 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:21.509004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03ed59-3996-4a7b-bcb3-18a4c5917d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:21.509277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03ed59-3996-4a7b-bcb3-18a4c5917d21 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:21.509977 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a03ed59-3996-4a7b-bcb3-18a4c5917d21 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:21.511467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a03ed59-3996-4a7b-bcb3-18a4c5917d21 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:21.519192 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbb47e-2de0-43fb-95d1-db59a05ab1ad None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:21.521599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-3a03ed59-3996-4a7b-bcb3-18a4c5917d21 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 20:27:21.521599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:21.521599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:27:21.521599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:27:21.521599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:27:21.521599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:27:21.521599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:27:21.521599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:27:21.521599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 20:27:21.521599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:21.521599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:27:21.521599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:21.521599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:21.521599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:21.521599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:21.521599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:21.521599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:21.522825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:21.522825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:21.522825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:21.522825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:21.522825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:21.522825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:21.522825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:27:21.522825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:27:21.522825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:27:21.522825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:27:21.522825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:21.522825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:21.522825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:21.522825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:21.522825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:21.522825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:21.523693 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:21.523693 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:21.523693 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:21.523693 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:21.523693 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:21.523693 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:21.523693 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:21.523693 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:21.523693 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:21.523693 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:21.523693 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:27:21.523693 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:27:21.523693 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 20:27:21.523693 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:21.523693 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 510/997] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:27:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:27:21.528431 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03ed59-3996-4a7b-bcb3-18a4c5917d21 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:21.559353 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba15be-a100-4ecb-b6de-477f361576cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:21.559964 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba15be-a100-4ecb-b6de-477f361576cf None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:21.560249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba15be-a100-4ecb-b6de-477f361576cf None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:21.560520 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba15be-a100-4ecb-b6de-477f361576cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:21.561237 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba15be-a100-4ecb-b6de-477f361576cf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:21.562688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba15be-a100-4ecb-b6de-477f361576cf None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:21.628875 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03ed59-3996-4a7b-bcb3-18a4c5917d21 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:21.641839 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 488/998] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 22 20:27:21 2022] POST /identity/v3/endpoints => generated 325 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:27:21.675411 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfbec7-66c5-4228-a285-31f72cfb8cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:21.676146 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfbec7-66c5-4228-a285-31f72cfb8cf6 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:21.676428 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfbec7-66c5-4228-a285-31f72cfb8cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:21.676726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfbec7-66c5-4228-a285-31f72cfb8cf6 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:21.677373 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dfbec7-66c5-4228-a285-31f72cfb8cf6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:21.677679 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dfbec7-66c5-4228-a285-31f72cfb8cf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:21.679271 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dfbec7-66c5-4228-a285-31f72cfb8cf6 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:21.685160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 511/999] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Aug 22 20:27:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:21.690848 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba15be-a100-4ecb-b6de-477f361576cf None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:21.715656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08a223-4873-47aa-b6a7-a8334903095c None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:21.716017 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08a223-4873-47aa-b6a7-a8334903095c None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:21.716210 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08a223-4873-47aa-b6a7-a8334903095c None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:21.717754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 512/1000] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:27:21.726106 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0de9e-9fff-4807-9183-a969f5680936 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:21.726293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0de9e-9fff-4807-9183-a969f5680936 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:21.726544 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0de9e-9fff-4807-9183-a969f5680936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:21.741758 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:21.747776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-f6c0de9e-9fff-4807-9183-a969f5680936 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:21.749003 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-f6c0de9e-9fff-4807-9183-a969f5680936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:21.794928 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:21.821214 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba15be-a100-4ecb-b6de-477f361576cf None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:21.831168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 513/1001] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:21 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:27:21.861173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c1205-fb73-4070-b31a-71244414ad62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:21.862166 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c1205-fb73-4070-b31a-71244414ad62 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:21.862676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c1205-fb73-4070-b31a-71244414ad62 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:21.863153 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c1205-fb73-4070-b31a-71244414ad62 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:21.864057 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c1205-fb73-4070-b31a-71244414ad62 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:21.864574 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c1205-fb73-4070-b31a-71244414ad62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:21.866231 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c1205-fb73-4070-b31a-71244414ad62 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:21.871955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 489/1002] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Aug 22 20:27:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:21.877900 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0de9e-9fff-4807-9183-a969f5680936 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:21.982201 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0de9e-9fff-4807-9183-a969f5680936 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:22.017011 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d125024-cae0-45cf-997a-91097bbfccfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:22.017622 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d125024-cae0-45cf-997a-91097bbfccfb None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:22.017902 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d125024-cae0-45cf-997a-91097bbfccfb None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:22.018174 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d125024-cae0-45cf-997a-91097bbfccfb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:22.018875 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d125024-cae0-45cf-997a-91097bbfccfb None admin] RBAC: Adding query filter params (interface=public, service_id=e4e40b9eafe74675b686a4ec61f27933, region_id=RegionOne) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:22.019183 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d125024-cae0-45cf-997a-91097bbfccfb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:22.020558 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d125024-cae0-45cf-997a-91097bbfccfb None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:22.025884 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 514/1003] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Aug 22 20:27:21 2022] GET /identity/v3/endpoints?service_id=e4e40b9eafe74675b686a4ec61f27933&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:22.031472 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c1205-fb73-4070-b31a-71244414ad62 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:22.105089 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d125024-cae0-45cf-997a-91097bbfccfb None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:22.135984 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c1205-fb73-4070-b31a-71244414ad62 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:22.137585 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:22.149344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:22.171388 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a889a-6b1f-4b05-9eca-f095d8855992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:22.173188 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a889a-6b1f-4b05-9eca-f095d8855992 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:22.173908 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a889a-6b1f-4b05-9eca-f095d8855992 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:22.174694 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a889a-6b1f-4b05-9eca-f095d8855992 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:22.175297 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a889a-6b1f-4b05-9eca-f095d8855992 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:22.176748 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a889a-6b1f-4b05-9eca-f095d8855992 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:22.183797 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 490/1004] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Aug 22 20:27:22 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:27:22.214874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d125024-cae0-45cf-997a-91097bbfccfb None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:22.254436 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8b100-11ee-4d99-9837-39bf2e376053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:22.255412 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8b100-11ee-4d99-9837-39bf2e376053 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:22.255875 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8b100-11ee-4d99-9837-39bf2e376053 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:22.256331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8b100-11ee-4d99-9837-39bf2e376053 None admin] PATH_INFO: `/v3/services/image` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:22.257146 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8b100-11ee-4d99-9837-39bf2e376053 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:22.258787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8b100-11ee-4d99-9837-39bf2e376053 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:22.268814 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-69c8b100-11ee-4d99-9837-39bf2e376053 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 20:27:22.268814 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:22.268814 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:27:22.268814 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:27:22.268814 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:27:22.268814 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:27:22.268814 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:27:22.268814 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:27:22.268814 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 20:27:22.268814 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:22.268814 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:27:22.268814 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:22.268814 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:22.268814 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:22.268814 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:22.268814 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:22.268814 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:22.269878 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:22.269878 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:22.269878 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:22.269878 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:22.269878 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:22.269878 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:22.269878 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:27:22.269878 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:27:22.269878 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:27:22.269878 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:27:22.269878 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:22.269878 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:22.269878 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:22.269878 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:22.269878 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:22.269878 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:22.270727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:22.270727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:22.270727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:22.270727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:22.270727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:22.270727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:22.270727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:22.270727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:22.270727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:22.270727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:22.270727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:27:22.270727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:27:22.270727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 20:27:22.270727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:22.272457 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 515/1005] 10.222.0.62 () {56 vars in 1105 bytes} [Mon Aug 22 20:27:22 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:27:22.278373 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a889a-6b1f-4b05-9eca-f095d8855992 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:22.389457 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a889a-6b1f-4b05-9eca-f095d8855992 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:22.425767 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f577129-7491-45cf-b38e-e8712e9ad6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:22.426807 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f577129-7491-45cf-b38e-e8712e9ad6e4 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:22.427292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f577129-7491-45cf-b38e-e8712e9ad6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:22.427854 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f577129-7491-45cf-b38e-e8712e9ad6e4 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:22.428722 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f577129-7491-45cf-b38e-e8712e9ad6e4 None admin] RBAC: Adding query filter params (name=image) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:22.429247 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f577129-7491-45cf-b38e-e8712e9ad6e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:22.430881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f577129-7491-45cf-b38e-e8712e9ad6e4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:22.436341 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 491/1006] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:22.442240 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8b100-11ee-4d99-9837-39bf2e376053 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:22.546259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8b100-11ee-4d99-9837-39bf2e376053 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:22.548145 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:22.583181 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4e0db-5c86-4b4a-b0c6-8fae9def6695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:22.583791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4e0db-5c86-4b4a-b0c6-8fae9def6695 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:22.584072 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4e0db-5c86-4b4a-b0c6-8fae9def6695 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:22.584353 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4e0db-5c86-4b4a-b0c6-8fae9def6695 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:22.585089 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f4e0db-5c86-4b4a-b0c6-8fae9def6695 None admin] RBAC: Adding query filter params (type=image) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:22.585488 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f4e0db-5c86-4b4a-b0c6-8fae9def6695 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:22.586773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f4e0db-5c86-4b4a-b0c6-8fae9def6695 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:22.596738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 516/1007] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:22 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:23.603587 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e4a38-e4a8-4fb0-9fce-fb464d6d1967 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:23.604121 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e4a38-e4a8-4fb0-9fce-fb464d6d1967 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:23.604121 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e4a38-e4a8-4fb0-9fce-fb464d6d1967 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:23.606723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 492/1008] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:23.611066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303179e7-c56c-411f-a7b0-5549735fe110 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:23.611489 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303179e7-c56c-411f-a7b0-5549735fe110 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:23.611668 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303179e7-c56c-411f-a7b0-5549735fe110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:23.629540 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-303179e7-c56c-411f-a7b0-5549735fe110 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:23.630732 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-303179e7-c56c-411f-a7b0-5549735fe110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:23.704982 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 517/1009] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:23 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:27:23.973163 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e4a38-e4a8-4fb0-9fce-fb464d6d1967 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:24.005393 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:24.077904 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e4a38-e4a8-4fb0-9fce-fb464d6d1967 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:24.112531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fd345-99c0-40d7-97bc-a78d3af92455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:24.113268 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fd345-99c0-40d7-97bc-a78d3af92455 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:24.113548 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fd345-99c0-40d7-97bc-a78d3af92455 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:24.113818 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fd345-99c0-40d7-97bc-a78d3af92455 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:24.114759 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9813bfd-39ef-48e0-aa76-161dd9046216 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:24.114958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8fd345-99c0-40d7-97bc-a78d3af92455 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:24.115135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9813bfd-39ef-48e0-aa76-161dd9046216 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:24.115304 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9813bfd-39ef-48e0-aa76-161dd9046216 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:24.116401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8fd345-99c0-40d7-97bc-a78d3af92455 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:24.116855 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 518/1010] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:27:24.118230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 493/1011] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:24.121846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705a934-8805-4d2a-9d12-307f863219d2 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:24.122211 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705a934-8805-4d2a-9d12-307f863219d2 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:24.122749 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705a934-8805-4d2a-9d12-307f863219d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:24.123518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fd345-99c0-40d7-97bc-a78d3af92455 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:24.141288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-4705a934-8805-4d2a-9d12-307f863219d2 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:24.142489 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-4705a934-8805-4d2a-9d12-307f863219d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:24.216011 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 519/1012] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:24 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:27:24.229754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:24.234206 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fd345-99c0-40d7-97bc-a78d3af92455 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:24.268075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2476734-4030-4431-90d6-6c1973a124d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:24.268704 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2476734-4030-4431-90d6-6c1973a124d2 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:24.268987 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2476734-4030-4431-90d6-6c1973a124d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:24.269257 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2476734-4030-4431-90d6-6c1973a124d2 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:24.269892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2476734-4030-4431-90d6-6c1973a124d2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:24.271309 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2476734-4030-4431-90d6-6c1973a124d2 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:24.384931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 494/1013] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Aug 22 20:27:24 2022] POST /identity/v3/projects => generated 311 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:27:24.485026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705a934-8805-4d2a-9d12-307f863219d2 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:24.510845 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4b60a-f69f-4e2f-b1dc-6bf77f01e027 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:24.511127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4b60a-f69f-4e2f-b1dc-6bf77f01e027 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:24.511399 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4b60a-f69f-4e2f-b1dc-6bf77f01e027 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:24.512753 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 495/1014] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:27:24.517578 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:24.519357 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1f5c5-ded2-445f-ac5a-c7bd967cf04a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:24.519639 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1f5c5-ded2-445f-ac5a-c7bd967cf04a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:24.519906 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1f5c5-ded2-445f-ac5a-c7bd967cf04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:24.538788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c0c1f5c5-ded2-445f-ac5a-c7bd967cf04a None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:24.539994 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c0c1f5c5-ded2-445f-ac5a-c7bd967cf04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:24.607791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705a934-8805-4d2a-9d12-307f863219d2 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:24.619869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 496/1015] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:24 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:27:24.644139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80747861-d0aa-4d5f-b9a7-aa8950d2e31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:24.644818 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80747861-d0aa-4d5f-b9a7-aa8950d2e31b None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:24.645060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80747861-d0aa-4d5f-b9a7-aa8950d2e31b None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:24.645321 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80747861-d0aa-4d5f-b9a7-aa8950d2e31b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:24.645894 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80747861-d0aa-4d5f-b9a7-aa8950d2e31b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:24.647247 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80747861-d0aa-4d5f-b9a7-aa8950d2e31b None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:24.656048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-80747861-d0aa-4d5f-b9a7-aa8950d2e31b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 20:27:24.656048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:24.656048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:27:24.656048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:27:24.656048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:27:24.656048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:27:24.656048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:27:24.656048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:27:24.656048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 20:27:24.656048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:24.656048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:27:24.656048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:24.656048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:24.656048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:24.656048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:24.656048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:24.656048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:24.657066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:24.657066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:24.657066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:24.657066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:24.657066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:24.657066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:24.657066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:27:24.657066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:27:24.657066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:27:24.657066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:27:24.657066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:24.657066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:24.657066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:24.657066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:24.657066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:24.657066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:24.658456 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:24.658456 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:24.658456 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:24.658456 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:24.658456 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:24.658456 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:24.658456 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:24.658456 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:24.658456 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:24.658456 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:24.658456 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:27:24.658456 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:27:24.658456 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 20:27:24.658456 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:24.658456 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 520/1016] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:27:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:24.664701 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1f5c5-ded2-445f-ac5a-c7bd967cf04a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:24.751456 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:24.771305 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1f5c5-ded2-445f-ac5a-c7bd967cf04a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:24.814589 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d1bf3-8d10-494c-a202-412dedbf9b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:24.815200 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d1bf3-8d10-494c-a202-412dedbf9b37 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:24.815476 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d1bf3-8d10-494c-a202-412dedbf9b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:24.815744 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d1bf3-8d10-494c-a202-412dedbf9b37 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:24.816375 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d1bf3-8d10-494c-a202-412dedbf9b37 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:24.816694 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d1bf3-8d10-494c-a202-412dedbf9b37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:24.818085 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d1bf3-8d10-494c-a202-412dedbf9b37 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:24.823164 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 497/1017] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Aug 22 20:27:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:24.829432 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80747861-d0aa-4d5f-b9a7-aa8950d2e31b None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:24.899174 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d1bf3-8d10-494c-a202-412dedbf9b37 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:24.922427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:24.932927 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80747861-d0aa-4d5f-b9a7-aa8950d2e31b None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:24.970089 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d0e5d-23ae-4891-a07f-dcfc648e9c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:24.970703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d0e5d-23ae-4891-a07f-dcfc648e9c79 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:24.970983 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d0e5d-23ae-4891-a07f-dcfc648e9c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:24.971258 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d0e5d-23ae-4891-a07f-dcfc648e9c79 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:24.971886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d0e5d-23ae-4891-a07f-dcfc648e9c79 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:24.972187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d0e5d-23ae-4891-a07f-dcfc648e9c79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:24.973582 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d0e5d-23ae-4891-a07f-dcfc648e9c79 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:24.979395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 521/1018] 10.222.0.62 () {56 vars in 1112 bytes} [Mon Aug 22 20:27:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:24.985289 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d0e5d-23ae-4891-a07f-dcfc648e9c79 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:25.006020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d1bf3-8d10-494c-a202-412dedbf9b37 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:25.039435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34c403-7b07-4dc2-8118-ef7442ae192a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:25.040037 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34c403-7b07-4dc2-8118-ef7442ae192a None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:25.040319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34c403-7b07-4dc2-8118-ef7442ae192a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:25.040581 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34c403-7b07-4dc2-8118-ef7442ae192a None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:25.041255 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34c403-7b07-4dc2-8118-ef7442ae192a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:25.042626 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34c403-7b07-4dc2-8118-ef7442ae192a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:25.095248 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d0e5d-23ae-4891-a07f-dcfc648e9c79 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:25.130980 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897542f-cbb5-4e10-925f-a1a4fa395eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:25.131878 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897542f-cbb5-4e10-925f-a1a4fa395eff None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:25.132328 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897542f-cbb5-4e10-925f-a1a4fa395eff None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:25.132779 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897542f-cbb5-4e10-925f-a1a4fa395eff None admin] PATH_INFO: `/v3/endpoints` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:25.133603 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897542f-cbb5-4e10-925f-a1a4fa395eff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:25.135163 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897542f-cbb5-4e10-925f-a1a4fa395eff None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:25.163775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 498/1019] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Aug 22 20:27:24 2022] POST /identity/v3/services => generated 242 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:27:25.273335 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 522/1020] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 22 20:27:24 2022] POST /identity/v3/endpoints => generated 334 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:27:26.369835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800384c-d1cb-4a42-b000-d87e0af25a4c None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:26.370392 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800384c-d1cb-4a42-b000-d87e0af25a4c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:26.370392 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800384c-d1cb-4a42-b000-d87e0af25a4c None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:26.371754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 499/1021] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:26.377601 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fa90e-6c5f-4268-ace1-f4b2f03fa0f2 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:26.378208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fa90e-6c5f-4268-ace1-f4b2f03fa0f2 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:26.378208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fa90e-6c5f-4268-ace1-f4b2f03fa0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:26.395967 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-b83fa90e-6c5f-4268-ace1-f4b2f03fa0f2 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:26.397193 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b83fa90e-6c5f-4268-ace1-f4b2f03fa0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:26.400896 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:26.473493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 523/1022] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:26 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:27:26.741882 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800384c-d1cb-4a42-b000-d87e0af25a4c None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:26.745803 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:26.860784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800384c-d1cb-4a42-b000-d87e0af25a4c None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:26.895440 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de998cb-4bed-4b0d-a95c-6a7e72b43790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:26.896080 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de998cb-4bed-4b0d-a95c-6a7e72b43790 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:26.896361 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de998cb-4bed-4b0d-a95c-6a7e72b43790 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:26.896635 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de998cb-4bed-4b0d-a95c-6a7e72b43790 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:26.897776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de998cb-4bed-4b0d-a95c-6a7e72b43790 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:26.899230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de998cb-4bed-4b0d-a95c-6a7e72b43790 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:26.904700 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 500/1023] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:26.907310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fa90e-6c5f-4268-ace1-f4b2f03fa0f2 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:27.008528 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83fa90e-6c5f-4268-ace1-f4b2f03fa0f2 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:27.043633 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc113ae-0843-4161-9273-bb77452d3046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:27.044250 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc113ae-0843-4161-9273-bb77452d3046 None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:27.044531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc113ae-0843-4161-9273-bb77452d3046 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:27.044831 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc113ae-0843-4161-9273-bb77452d3046 None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:27.045484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc113ae-0843-4161-9273-bb77452d3046 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:27.047872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc113ae-0843-4161-9273-bb77452d3046 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:27.057338 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:27.144684 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 524/1024] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Aug 22 20:27:26 2022] POST /identity/v3/users => generated 285 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:27:27.144884 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc4e8e-aa21-4345-81e0-6108bbaa101d None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:27.144884 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc4e8e-aa21-4345-81e0-6108bbaa101d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:27.144884 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc4e8e-aa21-4345-81e0-6108bbaa101d None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:27.145481 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 501/1025] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:27.151246 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb65920-dc6c-4e5c-9f24-25f3013fc220 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:27.151536 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb65920-dc6c-4e5c-9f24-25f3013fc220 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:27.151810 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb65920-dc6c-4e5c-9f24-25f3013fc220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:27.171605 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-4bb65920-dc6c-4e5c-9f24-25f3013fc220 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:27.172857 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-4bb65920-dc6c-4e5c-9f24-25f3013fc220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:27.247876 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 525/1026] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:27:27.281192 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e9a93-d214-4598-a760-2f2c14954484 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:27.281437 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e9a93-d214-4598-a760-2f2c14954484 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:27.281584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e9a93-d214-4598-a760-2f2c14954484 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:27.283077 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 502/1027] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:27.288518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b7134-0596-453b-ba3f-af4b992a8acb None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:27.288837 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b7134-0596-453b-ba3f-af4b992a8acb None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:27.289115 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b7134-0596-453b-ba3f-af4b992a8acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:27.308248 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-989b7134-0596-453b-ba3f-af4b992a8acb None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:27.309461 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-989b7134-0596-453b-ba3f-af4b992a8acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:27.380248 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 526/1028] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:27:27.522229 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e9a93-d214-4598-a760-2f2c14954484 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:27.598763 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:27.628620 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e9a93-d214-4598-a760-2f2c14954484 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:27.648979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b7134-0596-453b-ba3f-af4b992a8acb None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:27.666656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9c2e0-24e3-4d78-8956-e6d86ac8e509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:27.667285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9c2e0-24e3-4d78-8956-e6d86ac8e509 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:27.667562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9c2e0-24e3-4d78-8956-e6d86ac8e509 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:27.667853 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9c2e0-24e3-4d78-8956-e6d86ac8e509 None admin] PATH_INFO: `/v3/services/image` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:27.668405 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9c2e0-24e3-4d78-8956-e6d86ac8e509 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:27.669811 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9c2e0-24e3-4d78-8956-e6d86ac8e509 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:27.679467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-37f9c2e0-24e3-4d78-8956-e6d86ac8e509 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 20:27:27.679467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:27.679467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:27:27.679467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:27:27.679467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:27:27.679467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:27:27.679467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:27:27.679467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:27:27.679467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 20:27:27.679467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:27.679467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:27:27.679467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:27.679467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:27.679467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:27.679467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:27.679467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:27.679467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:27.680713 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:27.680713 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:27.680713 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:27.680713 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:27.680713 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:27.680713 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:27.680713 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:27:27.680713 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:27:27.680713 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:27:27.680713 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:27:27.680713 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:27.680713 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:27.680713 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:27.680713 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:27.680713 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:27.680713 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:27.683576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:27.683576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:27.683576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:27.683576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:27.683576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:27.683576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:27.683576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:27.683576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:27.683576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:27.683576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:27.683576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:27:27.683576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:27:27.683576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 20:27:27.683576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:27.684984 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 503/1029] 10.222.0.62 () {56 vars in 1105 bytes} [Mon Aug 22 20:27:27 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:27.686428 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9c2e0-24e3-4d78-8956-e6d86ac8e509 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:27.717171 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:27.769270 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b7134-0596-453b-ba3f-af4b992a8acb None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:27.798488 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9c2e0-24e3-4d78-8956-e6d86ac8e509 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:27.817746 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3b19f-f46f-4473-94b8-455e949cebd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:27.818682 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3b19f-f46f-4473-94b8-455e949cebd2 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:27.818962 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3b19f-f46f-4473-94b8-455e949cebd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:27.819236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3b19f-f46f-4473-94b8-455e949cebd2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:27.835264 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa3b19f-f46f-4473-94b8-455e949cebd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:27:27.835739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f7b2a-cd52-4f08-997e-5d309ba46f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:27.836345 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f7b2a-cd52-4f08-997e-5d309ba46f02 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:27.836623 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f7b2a-cd52-4f08-997e-5d309ba46f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:27.836923 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f7b2a-cd52-4f08-997e-5d309ba46f02 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:27.837549 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f7b2a-cd52-4f08-997e-5d309ba46f02 None admin] RBAC: Adding query filter params (name=image) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:27.837850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f7b2a-cd52-4f08-997e-5d309ba46f02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:27.839209 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f7b2a-cd52-4f08-997e-5d309ba46f02 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:27.839951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-3fa3b19f-f46f-4473-94b8-455e949cebd2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 20:27:27.839951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:27.839951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:27.839951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:27.839951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:27.839951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:27.839951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:27.839951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:27.839951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:27.839951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:27.839951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:27.839951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:27.839951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:27:27.839951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:27:27.839951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:27:27.839951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:27:27.841150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:27:27.841150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:27:27.841150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:27:27.841150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:27:27.841150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:27.841150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:27.841150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:27.841150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:27.841150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:27.841150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:27.841150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:27.841150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:27.841150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:27.841150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:27.841150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:27.841150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:27.842236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:27.842236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:27.842236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:27.842236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:27.842236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:27:27.842236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:27:27.842236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:27:27.842236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:27:27.842236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:27:27.842236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:27:27.842236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 20:27:27.842236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:27.842236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 527/1030] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Aug 22 20:27:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:27.845365 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:27.847840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3b19f-f46f-4473-94b8-455e949cebd2 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:27.849987 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 504/1031] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:27.850795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f7b2a-cd52-4f08-997e-5d309ba46f02 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:27.961809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3b19f-f46f-4473-94b8-455e949cebd2 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:27.963303 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f7b2a-cd52-4f08-997e-5d309ba46f02 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:27.976000 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:27.997815 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da17913-a467-440d-b21b-5393163e18b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:27.998010 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dda663-b7de-4278-941d-bfaac2e9452b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:27.998472 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dda663-b7de-4278-941d-bfaac2e9452b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:27.998664 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da17913-a467-440d-b21b-5393163e18b1 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:27.998780 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dda663-b7de-4278-941d-bfaac2e9452b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:27.998991 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dda663-b7de-4278-941d-bfaac2e9452b None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:27.999103 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da17913-a467-440d-b21b-5393163e18b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:27.999459 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da17913-a467-440d-b21b-5393163e18b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:27.999642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dda663-b7de-4278-941d-bfaac2e9452b None admin] RBAC: Adding query filter params (type=image) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:27.999945 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dda663-b7de-4278-941d-bfaac2e9452b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:28.000336 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da17913-a467-440d-b21b-5393163e18b1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:28.000742 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da17913-a467-440d-b21b-5393163e18b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:28.001528 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dda663-b7de-4278-941d-bfaac2e9452b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:28.002221 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da17913-a467-440d-b21b-5393163e18b1 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:28.006718 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 505/1032] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:27 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:28.012340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dda663-b7de-4278-941d-bfaac2e9452b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:28.012810 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 528/1033] 10.222.0.62 () {56 vars in 1115 bytes} [Mon Aug 22 20:27:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:28.017214 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da17913-a467-440d-b21b-5393163e18b1 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:28.081920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:28.121179 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da17913-a467-440d-b21b-5393163e18b1 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:28.124685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dda663-b7de-4278-941d-bfaac2e9452b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:28.157244 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb067b2-4684-4830-9909-32554cda635e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:28.157877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb067b2-4684-4830-9909-32554cda635e None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:28.158159 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb067b2-4684-4830-9909-32554cda635e None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:28.158432 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb067b2-4684-4830-9909-32554cda635e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:28.161083 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c7074-6a3e-4892-9843-53312ed2f037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:28.161792 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c7074-6a3e-4892-9843-53312ed2f037 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:28.162144 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c7074-6a3e-4892-9843-53312ed2f037 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:28.162516 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c7074-6a3e-4892-9843-53312ed2f037 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:28.163275 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c7074-6a3e-4892-9843-53312ed2f037 None admin] RBAC: Adding query filter params (interface=public, service_id=8e6ca8af7121450e8fbe3bb78acbe638, region_id=RegionOne) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:28.163647 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c7074-6a3e-4892-9843-53312ed2f037 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:28.165104 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c7074-6a3e-4892-9843-53312ed2f037 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:28.169246 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb067b2-4684-4830-9909-32554cda635e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:28.170394 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 506/1034] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Aug 22 20:27:28 2022] GET /identity/v3/endpoints?service_id=8e6ca8af7121450e8fbe3bb78acbe638&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:28.170864 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb067b2-4684-4830-9909-32554cda635e None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:28.175916 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c7074-6a3e-4892-9843-53312ed2f037 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:28.185499 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-eeb067b2-4684-4830-9909-32554cda635e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:28.185499 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:28.185499 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:28.185499 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:28.185499 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:28.185499 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:28.185499 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:28.185499 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:28.185499 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:28.185499 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:28.185499 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:28.185499 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:28.185499 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:27:28.185499 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:27:28.185499 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:27:28.185499 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:27:28.186484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:28.186484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:28.186484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:28.186484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:28.186484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:28.186484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:28.186484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:28.186484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:28.186484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:28.186484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:28.186484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:28.186484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:28.186484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:28.186484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:28.186484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:28.186484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:28.186484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:27:28.192787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:27:28.192787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:28.192787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:28.192787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 529/1035] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:27:28.192787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb067b2-4684-4830-9909-32554cda635e None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:28.233724 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:28.292213 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c7074-6a3e-4892-9843-53312ed2f037 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:28.313262 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb067b2-4684-4830-9909-32554cda635e None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:28.322197 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:28.331487 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16dd968-2c42-4adf-8640-9af4bef505ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:28.332091 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dd968-2c42-4adf-8640-9af4bef505ae None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:28.332369 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dd968-2c42-4adf-8640-9af4bef505ae None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:28.332637 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dd968-2c42-4adf-8640-9af4bef505ae None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:28.333261 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16dd968-2c42-4adf-8640-9af4bef505ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:28.334635 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16dd968-2c42-4adf-8640-9af4bef505ae None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:28.341201 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 507/1036] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Aug 22 20:27:28 2022] GET /identity/v3/services => generated 1957 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:27:28.352124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c0373-6ccc-4c45-b9eb-4f66a9c6b330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:28.352956 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c0373-6ccc-4c45-b9eb-4f66a9c6b330 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:28.353338 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c0373-6ccc-4c45-b9eb-4f66a9c6b330 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:28.353733 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c0373-6ccc-4c45-b9eb-4f66a9c6b330 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:28.354515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c0373-6ccc-4c45-b9eb-4f66a9c6b330 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:28.354921 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c0373-6ccc-4c45-b9eb-4f66a9c6b330 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:28.356442 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c0373-6ccc-4c45-b9eb-4f66a9c6b330 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:28.375393 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 530/1037] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:28.376498 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16dd968-2c42-4adf-8640-9af4bef505ae None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:28.491348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16dd968-2c42-4adf-8640-9af4bef505ae None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:28.528613 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ca2f8-04d1-4ab1-8cf7-ea1cbffbd710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:28.529285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ca2f8-04d1-4ab1-8cf7-ea1cbffbd710 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:28.529519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ca2f8-04d1-4ab1-8cf7-ea1cbffbd710 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:28.529784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ca2f8-04d1-4ab1-8cf7-ea1cbffbd710 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:28.538127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ca2f8-04d1-4ab1-8cf7-ea1cbffbd710 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:28.539552 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ca2f8-04d1-4ab1-8cf7-ea1cbffbd710 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:28.551441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-d17ca2f8-04d1-4ab1-8cf7-ea1cbffbd710 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:27:28.551441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:28.551441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:28.551441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:28.551441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:28.551441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:28.551441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:28.551441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:28.551441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:28.551441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:28.551441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:28.551441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:28.551441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:27:28.551441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:27:28.551441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:27:28.551441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:27:28.552474 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:28.552474 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:28.552474 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:27:28.552474 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:27:28.552474 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:27:28.552474 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:27:28.552474 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:28.552474 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:28.552474 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:28.552474 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:28.552474 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:28.552474 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:28.552474 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:28.552474 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:28.552474 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:28.552474 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:28.552474 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:28.552474 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:28.553494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:28.553494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:28.553494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:27:28.553494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:27:28.553494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:27:28.553494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:27:28.553494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:27:28.553494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:27:28.553494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:27:28.553494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:28.553494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 508/1038] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Aug 22 20:27:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:27:28.558239 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c0373-6ccc-4c45-b9eb-4f66a9c6b330 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:28.645058 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:28.660747 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c0373-6ccc-4c45-b9eb-4f66a9c6b330 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:28.695024 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e557a4-cb25-4cdc-81e7-f73cda7e2a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:28.695999 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e557a4-cb25-4cdc-81e7-f73cda7e2a21 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:28.696479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e557a4-cb25-4cdc-81e7-f73cda7e2a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:28.696971 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e557a4-cb25-4cdc-81e7-f73cda7e2a21 None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:28.697921 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e557a4-cb25-4cdc-81e7-f73cda7e2a21 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:28.698675 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e557a4-cb25-4cdc-81e7-f73cda7e2a21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:28.700285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e557a4-cb25-4cdc-81e7-f73cda7e2a21 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:28.725705 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 531/1039] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Aug 22 20:27:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:28.726674 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ca2f8-04d1-4ab1-8cf7-ea1cbffbd710 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:28.782417 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:28.839403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ca2f8-04d1-4ab1-8cf7-ea1cbffbd710 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:28.877269 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f53ffa-9144-49a9-a112-cc43b917b2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:28.877879 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f53ffa-9144-49a9-a112-cc43b917b2f0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:28.878162 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f53ffa-9144-49a9-a112-cc43b917b2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:28.878436 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f53ffa-9144-49a9-a112-cc43b917b2f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:28.947421 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f53ffa-9144-49a9-a112-cc43b917b2f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:28.949086 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f53ffa-9144-49a9-a112-cc43b917b2f0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:29.002516 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:29.050984 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 509/1040] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:27:28 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 20:27:29.056516 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e557a4-cb25-4cdc-81e7-f73cda7e2a21 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:29.155357 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28735424-01c3-4a0b-b248-b18b6d35f9f8 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:29.155679 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28735424-01c3-4a0b-b248-b18b6d35f9f8 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:29.155913 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28735424-01c3-4a0b-b248-b18b6d35f9f8 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:29.157410 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 510/1041] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:27:29.158301 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e557a4-cb25-4cdc-81e7-f73cda7e2a21 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:29.162275 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1fad1-9314-4a1f-9165-22e3bbb96d97 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:29.162558 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1fad1-9314-4a1f-9165-22e3bbb96d97 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:29.162828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1fad1-9314-4a1f-9165-22e3bbb96d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:29.180932 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-0db1fad1-9314-4a1f-9165-22e3bbb96d97 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:29.182134 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0db1fad1-9314-4a1f-9165-22e3bbb96d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:29.193792 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5072ea-6d5f-40de-acfc-9cf399222375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:29.194422 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5072ea-6d5f-40de-acfc-9cf399222375 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:29.194699 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5072ea-6d5f-40de-acfc-9cf399222375 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:29.194968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5072ea-6d5f-40de-acfc-9cf399222375 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:29.207033 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5072ea-6d5f-40de-acfc-9cf399222375 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:29.208943 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5072ea-6d5f-40de-acfc-9cf399222375 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:29.212225 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:29.228519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-6a5072ea-6d5f-40de-acfc-9cf399222375 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:29.228519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:29.228519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:29.228519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:29.228519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:29.228519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:29.228519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:29.228519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:29.228519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:29.228519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:29.228519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:29.228519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:29.228519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:27:29.228519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:27:29.228519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:27:29.228519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:27:29.229541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:29.229541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:29.229541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:29.229541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:29.229541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:29.229541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:29.229541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:29.229541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:29.229541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:29.229541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:29.229541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:29.229541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:29.229541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:29.229541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:29.229541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:29.229541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:29.229541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:27:29.230460 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:27:29.230460 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:29.230460 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:29.231355 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 532/1042] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:29.235174 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5072ea-6d5f-40de-acfc-9cf399222375 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:29.263828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 511/1043] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:27:29.340757 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5072ea-6d5f-40de-acfc-9cf399222375 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:29.377588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f621e-d256-46c3-83a5-f8c841bf2d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:29.378196 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f621e-d256-46c3-83a5-f8c841bf2d70 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:29.378479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f621e-d256-46c3-83a5-f8c841bf2d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:29.378751 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f621e-d256-46c3-83a5-f8c841bf2d70 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:29.379402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f621e-d256-46c3-83a5-f8c841bf2d70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:29.379705 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f621e-d256-46c3-83a5-f8c841bf2d70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:29.381115 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f621e-d256-46c3-83a5-f8c841bf2d70 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:29.394069 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 533/1044] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:29.399462 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1fad1-9314-4a1f-9165-22e3bbb96d97 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:29.485281 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:29.504183 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1fad1-9314-4a1f-9165-22e3bbb96d97 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:29.534367 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f621e-d256-46c3-83a5-f8c841bf2d70 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:29.541761 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f444a-37c2-4d06-8b33-f4d6d32db083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:29.542952 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f444a-37c2-4d06-8b33-f4d6d32db083 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:29.543891 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f444a-37c2-4d06-8b33-f4d6d32db083 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:29.544343 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f444a-37c2-4d06-8b33-f4d6d32db083 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:29.551780 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f444a-37c2-4d06-8b33-f4d6d32db083 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:29.553270 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f444a-37c2-4d06-8b33-f4d6d32db083 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:29.564391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-bc2f444a-37c2-4d06-8b33-f4d6d32db083 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:27:29.564391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:29.564391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:29.564391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:29.564391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:29.564391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:29.564391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:29.564391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:29.564391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:29.564391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:29.564391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:29.564391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:29.564391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:27:29.564391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:27:29.564391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:27:29.565312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:27:29.565312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:29.565312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:29.565312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:29.565312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:29.565312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:29.565312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:29.565312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:29.565312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:29.565312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:29.565312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:29.565312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:29.565312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:29.565312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:29.565312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:29.565312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:29.565312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:29.566217 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:27:29.566217 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:27:29.566217 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:27:29.566217 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:27:29.566217 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:27:29.566217 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:27:29.566217 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:27:29.566217 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:29.566217 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 512/1045] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:27:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:29.570908 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f444a-37c2-4d06-8b33-f4d6d32db083 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:29.605701 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:29.653884 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f621e-d256-46c3-83a5-f8c841bf2d70 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:29.678886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f444a-37c2-4d06-8b33-f4d6d32db083 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:29.692099 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19044c75-13ad-4718-80cd-bb2abf33e05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:29.692644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19044c75-13ad-4718-80cd-bb2abf33e05a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:29.692951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19044c75-13ad-4718-80cd-bb2abf33e05a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:29.693229 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19044c75-13ad-4718-80cd-bb2abf33e05a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:29.705209 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19044c75-13ad-4718-80cd-bb2abf33e05a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:27:29.710288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-19044c75-13ad-4718-80cd-bb2abf33e05a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:27:29.710288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:29.710288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:29.710288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:29.710288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:29.710288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:29.710288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:29.710288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:29.710288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:29.710288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:29.710288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:29.710288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:29.710288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:27:29.710288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:27:29.710288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:27:29.710288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:27:29.711234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:27:29.711234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:27:29.711234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:27:29.711234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:27:29.711234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:29.711234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:29.711234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:29.711234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:29.711234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:29.711234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:29.711234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:29.711234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:29.711234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:29.711234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:29.711234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:29.711234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:29.712074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:29.712074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:29.712074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:29.712074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:29.712074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:27:29.712074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:27:29.712074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:27:29.712074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:27:29.712074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:27:29.712074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:27:29.712074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:27:29.712074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:29.712074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 534/1046] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 22 20:27:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:27:29.717360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19044c75-13ad-4718-80cd-bb2abf33e05a None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:29.718572 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d1a61-4ead-425e-bd85-a4e9a00718dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:29.719333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d1a61-4ead-425e-bd85-a4e9a00718dc None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:29.719752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d1a61-4ead-425e-bd85-a4e9a00718dc None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:29.720173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d1a61-4ead-425e-bd85-a4e9a00718dc None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:29.721029 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d1a61-4ead-425e-bd85-a4e9a00718dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:29.721500 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d1a61-4ead-425e-bd85-a4e9a00718dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:29.722935 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d1a61-4ead-425e-bd85-a4e9a00718dc None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:29.741112 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 513/1047] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 22 20:27:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:29.742339 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d1a61-4ead-425e-bd85-a4e9a00718dc None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:29.745141 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:29.824226 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19044c75-13ad-4718-80cd-bb2abf33e05a None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:29.841233 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:29.858883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476d34b-5187-4b42-8c99-ecfd4438104a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:29.859500 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476d34b-5187-4b42-8c99-ecfd4438104a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:29.859778 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476d34b-5187-4b42-8c99-ecfd4438104a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:29.860054 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476d34b-5187-4b42-8c99-ecfd4438104a None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:29.860743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476d34b-5187-4b42-8c99-ecfd4438104a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:29.861039 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476d34b-5187-4b42-8c99-ecfd4438104a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:29.862554 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476d34b-5187-4b42-8c99-ecfd4438104a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:29.863345 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d1a61-4ead-425e-bd85-a4e9a00718dc None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:29.874600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 535/1048] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:27:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:29.880190 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476d34b-5187-4b42-8c99-ecfd4438104a None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:29.901643 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a38fc-92be-4b91-9188-11f4007378cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:29.902250 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a38fc-92be-4b91-9188-11f4007378cd None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:29.902536 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a38fc-92be-4b91-9188-11f4007378cd None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:29.903239 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a38fc-92be-4b91-9188-11f4007378cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:29.904192 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a38fc-92be-4b91-9188-11f4007378cd None admin] RBAC: Adding query filter params (role.id=0f0fc9106edb4456b2eafeeb4de00cc2, scope.project.id=783c362712d34405ab827e3f00a67995, user.id=9f1738f72b4848499cdf0ec6866c3c8f) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:29.904433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a38fc-92be-4b91-9188-11f4007378cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:29.906601 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a38fc-92be-4b91-9188-11f4007378cd None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:29.912444 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 514/1049] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:27:29 2022] GET /identity/v3/role_assignments?user.id=9f1738f72b4848499cdf0ec6866c3c8f&scope.project.id=783c362712d34405ab827e3f00a67995&role.id=0f0fc9106edb4456b2eafeeb4de00cc2 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:29.996173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476d34b-5187-4b42-8c99-ecfd4438104a None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:30.032265 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c2f5f-8a72-4792-9496-51d1cf0e3e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:30.032940 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c2f5f-8a72-4792-9496-51d1cf0e3e71 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:30.033217 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c2f5f-8a72-4792-9496-51d1cf0e3e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:30.033487 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c2f5f-8a72-4792-9496-51d1cf0e3e71 None admin] PATH_INFO: `/v3/users/2b6472075f1a47e9841e9774a615dd5e` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:30.049607 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230c2f5f-8a72-4792-9496-51d1cf0e3e71 None admin] RBAC: Authorizing `identity:get_user(user_id=2b6472075f1a47e9841e9774a615dd5e)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:30.051053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230c2f5f-8a72-4792-9496-51d1cf0e3e71 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:30.053048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 536/1050] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:27:29 2022] GET /identity/v3/users/2b6472075f1a47e9841e9774a615dd5e => generated 285 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:30.058534 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a38fc-92be-4b91-9188-11f4007378cd None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:30.129523 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:30.165057 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a38fc-92be-4b91-9188-11f4007378cd None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:30.199660 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8568491-8ffe-46f2-8a9f-254e8fd5f090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:30.200276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8568491-8ffe-46f2-8a9f-254e8fd5f090 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:30.200558 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8568491-8ffe-46f2-8a9f-254e8fd5f090 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:30.200858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8568491-8ffe-46f2-8a9f-254e8fd5f090 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:30.270338 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8568491-8ffe-46f2-8a9f-254e8fd5f090 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:30.271727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8568491-8ffe-46f2-8a9f-254e8fd5f090 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:30.291194 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98fe2e-18c3-44db-80f2-daa3940789ad None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:30.291194 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98fe2e-18c3-44db-80f2-daa3940789ad None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:30.291194 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98fe2e-18c3-44db-80f2-daa3940789ad None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:30.291194 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 537/1051] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:27:30.296948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec2a92-f33f-4767-b3e0-24c319fbf7b2 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:30.297369 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec2a92-f33f-4767-b3e0-24c319fbf7b2 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:30.297846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec2a92-f33f-4767-b3e0-24c319fbf7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:30.316312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-8dec2a92-f33f-4767-b3e0-24c319fbf7b2 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:30.317546 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-8dec2a92-f33f-4767-b3e0-24c319fbf7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:30.345230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:30.350690 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:30.385092 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 515/1052] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:27:30 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 20:27:30.391179 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8568491-8ffe-46f2-8a9f-254e8fd5f090 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:30.394260 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 538/1053] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:27:30.496179 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8568491-8ffe-46f2-8a9f-254e8fd5f090 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:30.532062 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c59a63-5bd9-4255-a725-0ef749d1b556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:30.532616 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c59a63-5bd9-4255-a725-0ef749d1b556 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:30.532968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c59a63-5bd9-4255-a725-0ef749d1b556 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:30.533244 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c59a63-5bd9-4255-a725-0ef749d1b556 None admin] PATH_INFO: `/v3/projects/e52d6b68dc1e4678abf6e98f46f93844` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:30.534344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c59a63-5bd9-4255-a725-0ef749d1b556 None admin] RBAC: Authorizing `identity:get_project(project_id=e52d6b68dc1e4678abf6e98f46f93844)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:30.535904 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c59a63-5bd9-4255-a725-0ef749d1b556 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:30.542386 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 516/1054] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:27:30 2022] GET /identity/v3/projects/e52d6b68dc1e4678abf6e98f46f93844 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:30.543599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec2a92-f33f-4767-b3e0-24c319fbf7b2 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:30.645478 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec2a92-f33f-4767-b3e0-24c319fbf7b2 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:30.666604 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c59a63-5bd9-4255-a725-0ef749d1b556 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:30.680937 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ef215-c08e-4026-b61c-e5bf2cf9b76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:30.681691 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ef215-c08e-4026-b61c-e5bf2cf9b76b None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:30.681967 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ef215-c08e-4026-b61c-e5bf2cf9b76b None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:30.682582 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ef215-c08e-4026-b61c-e5bf2cf9b76b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:30.683575 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ef215-c08e-4026-b61c-e5bf2cf9b76b None admin] RBAC: Adding query filter params (role.id=e3faa0474c054da6bb4d8910a4e40bff, scope.project.id=e52d6b68dc1e4678abf6e98f46f93844, user.id=2b6472075f1a47e9841e9774a615dd5e) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:30.683886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ef215-c08e-4026-b61c-e5bf2cf9b76b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:30.685482 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ef215-c08e-4026-b61c-e5bf2cf9b76b None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:30.700692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 539/1055] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:27:30 2022] GET /identity/v3/role_assignments?user.id=2b6472075f1a47e9841e9774a615dd5e&scope.project.id=e52d6b68dc1e4678abf6e98f46f93844&role.id=e3faa0474c054da6bb4d8910a4e40bff => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:30.703029 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:30.779853 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c59a63-5bd9-4255-a725-0ef749d1b556 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:30.824328 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f83255-9611-4dc9-82ae-c6d3a12e9372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:30.825195 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f83255-9611-4dc9-82ae-c6d3a12e9372 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:30.825475 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f83255-9611-4dc9-82ae-c6d3a12e9372 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:30.825743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f83255-9611-4dc9-82ae-c6d3a12e9372 None admin] PATH_INFO: `/v3/services/image` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:30.826325 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f83255-9611-4dc9-82ae-c6d3a12e9372 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:30.829079 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f83255-9611-4dc9-82ae-c6d3a12e9372 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:30.846917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-95f83255-9611-4dc9-82ae-c6d3a12e9372 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 20:27:30.846917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:30.846917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:27:30.846917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:27:30.846917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:27:30.846917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:27:30.846917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:27:30.846917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:27:30.846917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 20:27:30.846917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:30.846917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:27:30.846917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:30.846917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:30.846917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:30.846917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:30.846917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:30.846917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:30.848002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:30.848002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:30.848002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:30.848002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:30.848002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:30.848002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:30.848002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:27:30.848002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:27:30.848002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:27:30.848002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:27:30.848002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:30.848002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:30.848002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:30.848002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:30.848002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:30.848002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:30.848899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:30.848899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:30.848899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:30.848899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:30.848899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:30.848899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:30.848899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:30.848899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:30.848899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:30.848899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:30.848899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:27:30.848899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:27:30.848899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 20:27:30.848899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:30.848899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 517/1056] 10.222.0.62 () {56 vars in 1105 bytes} [Mon Aug 22 20:27:30 2022] GET /identity/v3/services/image => generated 86 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:27:30.859178 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ef215-c08e-4026-b61c-e5bf2cf9b76b None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:30.892045 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:30.962686 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ef215-c08e-4026-b61c-e5bf2cf9b76b None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:31.000104 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd69dc7-5110-41e1-87ea-dbc500f6baf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:31.000738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd69dc7-5110-41e1-87ea-dbc500f6baf7 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:31.001020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd69dc7-5110-41e1-87ea-dbc500f6baf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:31.001292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd69dc7-5110-41e1-87ea-dbc500f6baf7 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:31.001924 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd69dc7-5110-41e1-87ea-dbc500f6baf7 None admin] RBAC: Adding query filter params (name=image) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:31.002225 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd69dc7-5110-41e1-87ea-dbc500f6baf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:31.003595 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd69dc7-5110-41e1-87ea-dbc500f6baf7 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:31.013154 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 540/1057] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:31.014333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f83255-9611-4dc9-82ae-c6d3a12e9372 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:31.119299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:31.123659 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f83255-9611-4dc9-82ae-c6d3a12e9372 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:31.160158 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad58ea-81f8-4de1-b0b3-2225f2efd8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:31.160797 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad58ea-81f8-4de1-b0b3-2225f2efd8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:31.161076 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad58ea-81f8-4de1-b0b3-2225f2efd8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:31.161346 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad58ea-81f8-4de1-b0b3-2225f2efd8d0 None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:31.161973 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad58ea-81f8-4de1-b0b3-2225f2efd8d0 None admin] RBAC: Adding query filter params (type=image) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:31.162271 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad58ea-81f8-4de1-b0b3-2225f2efd8d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:31.163642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad58ea-81f8-4de1-b0b3-2225f2efd8d0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:31.172690 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 518/1058] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:31.174908 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd69dc7-5110-41e1-87ea-dbc500f6baf7 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:31.270722 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:31.277991 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd69dc7-5110-41e1-87ea-dbc500f6baf7 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:31.312351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e930b-c31a-4231-94e1-0568d9f4558b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:31.313198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e930b-c31a-4231-94e1-0568d9f4558b None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:31.313519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e930b-c31a-4231-94e1-0568d9f4558b None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:31.313963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e930b-c31a-4231-94e1-0568d9f4558b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:31.314968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e930b-c31a-4231-94e1-0568d9f4558b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:31.316488 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e930b-c31a-4231-94e1-0568d9f4558b None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:31.422208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 541/1059] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 22 20:27:31 2022] POST /identity/v3/endpoints => generated 327 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:27:31.820152 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d48d24-9674-409f-8d78-69152c8eb5a5 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:31.820819 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d48d24-9674-409f-8d78-69152c8eb5a5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:31.820819 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d48d24-9674-409f-8d78-69152c8eb5a5 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:31.822071 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 519/1060] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:31.827853 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474902b-3e93-4e15-961c-7c39eed82298 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:31.828281 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474902b-3e93-4e15-961c-7c39eed82298 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:31.828588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474902b-3e93-4e15-961c-7c39eed82298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:31.847264 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-7474902b-3e93-4e15-961c-7c39eed82298 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:31.848554 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-7474902b-3e93-4e15-961c-7c39eed82298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:31.926359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 542/1061] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:27:32.202838 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d48d24-9674-409f-8d78-69152c8eb5a5 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:32.308351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d48d24-9674-409f-8d78-69152c8eb5a5 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:32.342378 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab0974-6e3b-41c4-b3ba-9fe60bb3e6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:32.343859 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab0974-6e3b-41c4-b3ba-9fe60bb3e6eb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:32.344145 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab0974-6e3b-41c4-b3ba-9fe60bb3e6eb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:32.344421 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab0974-6e3b-41c4-b3ba-9fe60bb3e6eb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:32.355167 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab0974-6e3b-41c4-b3ba-9fe60bb3e6eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:27:32.360611 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-d4ab0974-6e3b-41c4-b3ba-9fe60bb3e6eb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 20:27:32.360611 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:32.360611 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:32.360611 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:32.360611 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:32.360611 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:32.360611 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:32.360611 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:32.360611 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:32.360611 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:32.360611 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:32.360611 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:32.360611 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:27:32.360611 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:27:32.360611 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:27:32.360611 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:27:32.361666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:27:32.361666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:27:32.361666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:27:32.361666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:27:32.361666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:32.361666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:32.361666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:32.361666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:32.361666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:32.361666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:32.361666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:32.361666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:32.361666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:32.361666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:32.361666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:32.361666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:32.362595 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:32.362595 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:32.362595 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:32.362595 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:32.362595 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:27:32.362595 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:27:32.362595 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:27:32.362595 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:27:32.362595 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:27:32.362595 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:27:32.362595 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 20:27:32.362595 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:32.364756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 520/1062] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Aug 22 20:27:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:32.368231 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474902b-3e93-4e15-961c-7c39eed82298 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:32.447392 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:32.474239 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474902b-3e93-4e15-961c-7c39eed82298 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:32.511850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e6a64-6249-4cdd-bb6b-9f479b4f876a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:32.512496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e6a64-6249-4cdd-bb6b-9f479b4f876a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:32.512883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e6a64-6249-4cdd-bb6b-9f479b4f876a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:32.513166 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e6a64-6249-4cdd-bb6b-9f479b4f876a None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:32.513860 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9e6a64-6249-4cdd-bb6b-9f479b4f876a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:32.514164 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9e6a64-6249-4cdd-bb6b-9f479b4f876a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:32.516344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9e6a64-6249-4cdd-bb6b-9f479b4f876a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:32.526064 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 543/1063] 10.222.0.62 () {56 vars in 1115 bytes} [Mon Aug 22 20:27:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:32.532051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab0974-6e3b-41c4-b3ba-9fe60bb3e6eb None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:32.557190 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:32.633949 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab0974-6e3b-41c4-b3ba-9fe60bb3e6eb None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:32.640232 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e016d-982d-4364-a7fd-b793719a0b13 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:32.640521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e016d-982d-4364-a7fd-b793719a0b13 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:32.640845 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e016d-982d-4364-a7fd-b793719a0b13 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:32.642293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 544/1064] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:32.647411 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf2d28-e365-42b0-b16c-8b1916dea02e None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:32.647703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf2d28-e365-42b0-b16c-8b1916dea02e None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:32.647982 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf2d28-e365-42b0-b16c-8b1916dea02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:32.667005 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-cecf2d28-e365-42b0-b16c-8b1916dea02e None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:32.668202 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-cecf2d28-e365-42b0-b16c-8b1916dea02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:32.670382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa904c9-2c4c-4364-acc8-7b564db03bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:32.671048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa904c9-2c4c-4364-acc8-7b564db03bba None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:32.671323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa904c9-2c4c-4364-acc8-7b564db03bba None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:32.671588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa904c9-2c4c-4364-acc8-7b564db03bba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:32.682046 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa904c9-2c4c-4364-acc8-7b564db03bba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:32.683485 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa904c9-2c4c-4364-acc8-7b564db03bba None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:32.697262 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-8aa904c9-2c4c-4364-acc8-7b564db03bba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:32.697262 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:32.697262 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:32.697262 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:32.697262 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:32.697262 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:32.697262 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:32.697262 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:32.697262 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:32.697262 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:32.697262 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:32.697262 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:32.697262 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:27:32.697262 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:27:32.697262 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:27:32.697262 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:27:32.698498 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:32.698498 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:32.698498 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:32.698498 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:32.698498 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:32.698498 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:32.698498 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:32.698498 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:32.698498 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:32.698498 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:32.698498 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:32.698498 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:32.698498 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:32.698498 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:32.698498 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:32.698498 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:32.698498 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:27:32.699377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:27:32.699377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:32.699377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:32.703953 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 521/1065] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:32.704771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa904c9-2c4c-4364-acc8-7b564db03bba None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:32.741210 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 545/1066] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:27:32.780087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:32.813908 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa904c9-2c4c-4364-acc8-7b564db03bba None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:32.848823 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5fa263-8c16-45a7-942f-5e8ac99a0998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:32.849484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fa263-8c16-45a7-942f-5e8ac99a0998 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:32.849719 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fa263-8c16-45a7-942f-5e8ac99a0998 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:32.849946 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fa263-8c16-45a7-942f-5e8ac99a0998 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:32.850573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5fa263-8c16-45a7-942f-5e8ac99a0998 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:32.850866 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5fa263-8c16-45a7-942f-5e8ac99a0998 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:32.852234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5fa263-8c16-45a7-942f-5e8ac99a0998 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:32.865292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 522/1067] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:32.870677 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf2d28-e365-42b0-b16c-8b1916dea02e None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:32.939829 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:32.973430 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf2d28-e365-42b0-b16c-8b1916dea02e None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:33.006711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37682a63-94d3-45c3-82e5-679882968fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:33.007263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37682a63-94d3-45c3-82e5-679882968fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:33.007539 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37682a63-94d3-45c3-82e5-679882968fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:33.007808 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37682a63-94d3-45c3-82e5-679882968fd2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:33.012256 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5fa263-8c16-45a7-942f-5e8ac99a0998 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:33.016391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37682a63-94d3-45c3-82e5-679882968fd2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:33.017858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37682a63-94d3-45c3-82e5-679882968fd2 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:33.028944 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-37682a63-94d3-45c3-82e5-679882968fd2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:27:33.028944 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:33.028944 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:33.028944 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:33.028944 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:33.028944 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:33.028944 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:33.028944 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:33.028944 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:33.028944 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:33.028944 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:33.028944 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:33.028944 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:27:33.028944 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:27:33.028944 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:27:33.028944 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:27:33.030163 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:33.030163 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:33.030163 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:27:33.030163 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:27:33.030163 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:27:33.030163 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:27:33.030163 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:33.030163 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:33.030163 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:33.030163 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:33.030163 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:33.030163 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:33.030163 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:33.030163 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:33.030163 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:33.030163 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:33.030163 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:33.030163 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:33.031256 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:33.031256 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:33.031256 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:27:33.031256 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:27:33.031256 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:27:33.031256 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:27:33.031256 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:27:33.031256 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:27:33.031256 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:27:33.031256 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:33.031256 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 546/1068] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Aug 22 20:27:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:33.036236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37682a63-94d3-45c3-82e5-679882968fd2 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:33.138291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5fa263-8c16-45a7-942f-5e8ac99a0998 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:33.142216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37682a63-94d3-45c3-82e5-679882968fd2 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:33.167804 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:33.176779 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8a7de-bd0c-4f46-9606-a68df2de1bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:33.177388 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8a7de-bd0c-4f46-9606-a68df2de1bab None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:33.177672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8a7de-bd0c-4f46-9606-a68df2de1bab None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:33.177941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8a7de-bd0c-4f46-9606-a68df2de1bab None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:33.178674 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8a7de-bd0c-4f46-9606-a68df2de1bab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:33.178979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8a7de-bd0c-4f46-9606-a68df2de1bab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:33.180400 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8a7de-bd0c-4f46-9606-a68df2de1bab None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:33.180948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c4658-ba03-4e8d-8e16-112e3de2e8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:33.181570 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c4658-ba03-4e8d-8e16-112e3de2e8fe None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:33.181843 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c4658-ba03-4e8d-8e16-112e3de2e8fe None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:33.187788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c4658-ba03-4e8d-8e16-112e3de2e8fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:33.187788 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:33.194445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c4658-ba03-4e8d-8e16-112e3de2e8fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:27:33.199056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 547/1069] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Aug 22 20:27:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:33.199435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-6d3c4658-ba03-4e8d-8e16-112e3de2e8fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:27:33.199435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:33.199435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:33.199435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:33.199435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:33.199435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:33.199435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:33.199435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:33.199435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:33.199435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:33.199435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:33.199435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:33.199435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:27:33.199435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:27:33.199435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:27:33.199435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:27:33.200335 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:27:33.200335 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:27:33.200335 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:27:33.200335 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:27:33.200335 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:33.200335 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:33.200335 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:33.200335 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:33.200335 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:33.200335 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:33.200335 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:33.200335 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:33.200335 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:33.200335 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:33.200335 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:33.200335 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:33.201207 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:33.201207 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:33.201207 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:33.201207 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:33.201207 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:27:33.201207 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:27:33.201207 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:27:33.201207 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:27:33.201207 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:27:33.201207 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:27:33.201207 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:27:33.201207 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:33.201207 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 523/1070] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 22 20:27:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:27:33.206947 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8a7de-bd0c-4f46-9606-a68df2de1bab None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:33.207846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c4658-ba03-4e8d-8e16-112e3de2e8fe None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:33.311550 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c4658-ba03-4e8d-8e16-112e3de2e8fe None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:33.315085 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8a7de-bd0c-4f46-9606-a68df2de1bab None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:33.348556 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81642b47-57c1-4b15-922c-cd91fbd950f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:33.349200 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81642b47-57c1-4b15-922c-cd91fbd950f7 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:33.349476 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81642b47-57c1-4b15-922c-cd91fbd950f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:33.349745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81642b47-57c1-4b15-922c-cd91fbd950f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:33.350406 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81642b47-57c1-4b15-922c-cd91fbd950f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:33.350701 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81642b47-57c1-4b15-922c-cd91fbd950f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:33.352075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81642b47-57c1-4b15-922c-cd91fbd950f7 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:33.353906 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84036a19-fcd7-44b2-80f7-1e43dc153461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:33.354690 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84036a19-fcd7-44b2-80f7-1e43dc153461 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:33.355107 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84036a19-fcd7-44b2-80f7-1e43dc153461 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:33.355612 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84036a19-fcd7-44b2-80f7-1e43dc153461 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:33.360914 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 524/1071] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:27:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:33.362228 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba41247-ee7b-4c64-b17f-6d136abb87ca None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:33.362518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba41247-ee7b-4c64-b17f-6d136abb87ca None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:33.362789 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba41247-ee7b-4c64-b17f-6d136abb87ca None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:33.364073 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 525/1072] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:33.366123 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84036a19-fcd7-44b2-80f7-1e43dc153461 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:33.367514 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba41247-ee7b-4c64-b17f-6d136abb87ca None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:33.367636 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84036a19-fcd7-44b2-80f7-1e43dc153461 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:33.382656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-84036a19-fcd7-44b2-80f7-1e43dc153461 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:33.382656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:33.382656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:33.382656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:33.382656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:33.382656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:33.382656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:33.382656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:33.382656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:33.382656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:33.382656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:33.382656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:33.382656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:27:33.382656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:27:33.382656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:27:33.382656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:27:33.383739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:33.383739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:33.383739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:33.383739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:33.383739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:33.383739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:33.383739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:33.383739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:33.383739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:33.383739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:33.383739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:33.383739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:33.383739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:33.383739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:33.383739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:33.383739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:33.383739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:27:33.384623 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:27:33.384623 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:33.384623 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:33.384623 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 548/1073] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:27:33.384879 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d3dd9-31cc-4d8f-bda5-60938629ecfa None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:33.385174 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d3dd9-31cc-4d8f-bda5-60938629ecfa None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:33.385478 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d3dd9-31cc-4d8f-bda5-60938629ecfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:33.402946 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-d70d3dd9-31cc-4d8f-bda5-60938629ecfa None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:33.404116 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-d70d3dd9-31cc-4d8f-bda5-60938629ecfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:33.431273 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:33.433393 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:33.470714 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 549/1074] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:27:33.471628 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d3dd9-31cc-4d8f-bda5-60938629ecfa None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:33.477255 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba41247-ee7b-4c64-b17f-6d136abb87ca None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:33.516305 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded650e6-1ece-4ad6-93a2-e42842640b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:33.516977 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded650e6-1ece-4ad6-93a2-e42842640b71 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:33.517258 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded650e6-1ece-4ad6-93a2-e42842640b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:33.517531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded650e6-1ece-4ad6-93a2-e42842640b71 None admin] PATH_INFO: `/v3/users/2b6472075f1a47e9841e9774a615dd5e` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:33.518684 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded650e6-1ece-4ad6-93a2-e42842640b71 None admin] RBAC: Authorizing `identity:get_user(user_id=2b6472075f1a47e9841e9774a615dd5e)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:33.520253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded650e6-1ece-4ad6-93a2-e42842640b71 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:33.522042 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 526/1075] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:27:33 2022] GET /identity/v3/users/2b6472075f1a47e9841e9774a615dd5e => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:33.527497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded650e6-1ece-4ad6-93a2-e42842640b71 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:33.571898 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d3dd9-31cc-4d8f-bda5-60938629ecfa None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:33.606996 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc11c7-feeb-4a02-b784-14e0ce38595e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:33.607608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc11c7-feeb-4a02-b784-14e0ce38595e None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:33.607890 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc11c7-feeb-4a02-b784-14e0ce38595e None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:33.608806 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc11c7-feeb-4a02-b784-14e0ce38595e None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:33.609431 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc11c7-feeb-4a02-b784-14e0ce38595e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:33.609742 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc11c7-feeb-4a02-b784-14e0ce38595e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:33.611105 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc11c7-feeb-4a02-b784-14e0ce38595e None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:33.627402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 550/1076] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:33.628282 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc11c7-feeb-4a02-b784-14e0ce38595e None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:33.632370 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded650e6-1ece-4ad6-93a2-e42842640b71 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:33.656435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:33.658172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:33.668180 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c9cf0-73ce-4f04-9c43-f74db5c1cc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:33.668838 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c9cf0-73ce-4f04-9c43-f74db5c1cc9a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:33.669117 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c9cf0-73ce-4f04-9c43-f74db5c1cc9a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:33.669385 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c9cf0-73ce-4f04-9c43-f74db5c1cc9a None admin] PATH_INFO: `/v3/projects/e52d6b68dc1e4678abf6e98f46f93844` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:33.671274 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c9cf0-73ce-4f04-9c43-f74db5c1cc9a None admin] RBAC: Authorizing `identity:get_project(project_id=e52d6b68dc1e4678abf6e98f46f93844)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:33.672914 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c9cf0-73ce-4f04-9c43-f74db5c1cc9a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:33.674697 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 527/1077] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:27:33 2022] GET /identity/v3/projects/e52d6b68dc1e4678abf6e98f46f93844 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:33.680479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c9cf0-73ce-4f04-9c43-f74db5c1cc9a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:33.743191 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc11c7-feeb-4a02-b784-14e0ce38595e None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:33.777039 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530c063-cc76-49fe-92a2-3715675f37c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:33.777666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530c063-cc76-49fe-92a2-3715675f37c6 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:33.777939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530c063-cc76-49fe-92a2-3715675f37c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:33.778200 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530c063-cc76-49fe-92a2-3715675f37c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:33.784512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c9cf0-73ce-4f04-9c43-f74db5c1cc9a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:33.785354 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d530c063-cc76-49fe-92a2-3715675f37c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:33.786787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d530c063-cc76-49fe-92a2-3715675f37c6 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:33.799100 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-d530c063-cc76-49fe-92a2-3715675f37c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:27:33.799100 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:33.799100 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:33.799100 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:33.799100 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:33.799100 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:33.799100 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:33.799100 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:33.799100 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:33.799100 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:33.799100 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:33.799100 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:33.799100 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:27:33.799100 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:27:33.799100 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:27:33.800186 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:27:33.800186 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:33.800186 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:33.800186 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:33.800186 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:33.800186 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:33.800186 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:33.800186 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:33.800186 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:33.800186 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:33.800186 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:33.800186 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:33.800186 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:33.800186 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:33.800186 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:33.800186 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:33.800186 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:33.801293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:27:33.801293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:27:33.801293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:27:33.801293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:27:33.801293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:27:33.801293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:27:33.801293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:27:33.801293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:33.801293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 551/1078] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:27:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:33.801773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530c063-cc76-49fe-92a2-3715675f37c6 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:33.825000 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d44b83-5e08-4eec-8100-6fe4ad3450d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:33.825583 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d44b83-5e08-4eec-8100-6fe4ad3450d4 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:33.825859 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d44b83-5e08-4eec-8100-6fe4ad3450d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:33.826127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d44b83-5e08-4eec-8100-6fe4ad3450d4 None admin] PATH_INFO: `/v3/projects/e52d6b68dc1e4678abf6e98f46f93844/users/2b6472075f1a47e9841e9774a615dd5e/roles/e3faa0474c054da6bb4d8910a4e40bff` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:33.828133 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d44b83-5e08-4eec-8100-6fe4ad3450d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=e52d6b68dc1e4678abf6e98f46f93844, user_id=2b6472075f1a47e9841e9774a615dd5e, role_id=e3faa0474c054da6bb4d8910a4e40bff)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:33.829588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d44b83-5e08-4eec-8100-6fe4ad3450d4 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:33.890865 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:33.902387 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 528/1079] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 22 20:27:33 2022] PUT /identity/v3/projects/e52d6b68dc1e4678abf6e98f46f93844/users/2b6472075f1a47e9841e9774a615dd5e/roles/e3faa0474c054da6bb4d8910a4e40bff => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:27:33.902843 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530c063-cc76-49fe-92a2-3715675f37c6 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:33.903829 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d44b83-5e08-4eec-8100-6fe4ad3450d4 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:33.945330 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8648e34-c829-48bb-9482-6a4929ecc13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:33.945944 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8648e34-c829-48bb-9482-6a4929ecc13a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:33.946222 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8648e34-c829-48bb-9482-6a4929ecc13a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:33.946632 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8648e34-c829-48bb-9482-6a4929ecc13a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:33.984407 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:34.033505 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8648e34-c829-48bb-9482-6a4929ecc13a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:34.035236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8648e34-c829-48bb-9482-6a4929ecc13a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:34.036154 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d44b83-5e08-4eec-8100-6fe4ad3450d4 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:34.078336 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecc3bf-91fa-4128-a563-0412c6864ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:34.078869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecc3bf-91fa-4128-a563-0412c6864ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:34.079142 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecc3bf-91fa-4128-a563-0412c6864ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:34.079421 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecc3bf-91fa-4128-a563-0412c6864ba2 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:34.080116 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ecc3bf-91fa-4128-a563-0412c6864ba2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:34.080420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ecc3bf-91fa-4128-a563-0412c6864ba2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:34.081898 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ecc3bf-91fa-4128-a563-0412c6864ba2 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:34.095002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 529/1080] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 22 20:27:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:34.100625 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecc3bf-91fa-4128-a563-0412c6864ba2 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:34.133912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:34.147874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 552/1081] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:27:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 20:27:34.153728 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8648e34-c829-48bb-9482-6a4929ecc13a None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:34.213461 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecc3bf-91fa-4128-a563-0412c6864ba2 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:34.228508 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:34.251790 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898acdf7-bd57-4df6-810f-3cad836efd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:34.252457 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898acdf7-bd57-4df6-810f-3cad836efd31 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:34.252790 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898acdf7-bd57-4df6-810f-3cad836efd31 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:34.253048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898acdf7-bd57-4df6-810f-3cad836efd31 None admin] PATH_INFO: `/v3/projects/783c362712d34405ab827e3f00a67995/users/9f1738f72b4848499cdf0ec6866c3c8f/roles/0f0fc9106edb4456b2eafeeb4de00cc2` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:34.255281 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898acdf7-bd57-4df6-810f-3cad836efd31 None admin] RBAC: Authorizing `identity:create_grant(project_id=783c362712d34405ab827e3f00a67995, user_id=9f1738f72b4848499cdf0ec6866c3c8f, role_id=0f0fc9106edb4456b2eafeeb4de00cc2)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:34.256746 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898acdf7-bd57-4df6-810f-3cad836efd31 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:34.267956 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8648e34-c829-48bb-9482-6a4929ecc13a None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:34.301450 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62380a9e-c50a-4e8e-b690-6c3b15e0d67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:34.302067 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62380a9e-c50a-4e8e-b690-6c3b15e0d67d None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:34.302345 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62380a9e-c50a-4e8e-b690-6c3b15e0d67d None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:34.302616 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62380a9e-c50a-4e8e-b690-6c3b15e0d67d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:34.313241 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62380a9e-c50a-4e8e-b690-6c3b15e0d67d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:34.314688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62380a9e-c50a-4e8e-b690-6c3b15e0d67d None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:34.330377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-62380a9e-c50a-4e8e-b690-6c3b15e0d67d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:34.330377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:34.330377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:34.330377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:34.330377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:34.330377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:34.330377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:34.330377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:34.330377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:34.330377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:34.330377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:34.330377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:34.330377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:27:34.330377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:27:34.330377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:27:34.330377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:27:34.331464 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:34.331464 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:34.331464 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:34.331464 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:34.331464 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:34.331464 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:34.331464 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:34.331464 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:34.331464 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:34.331464 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:34.331464 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:34.331464 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:34.331464 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:34.331464 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:34.331464 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:34.331464 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:34.331464 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:27:34.332456 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:27:34.332456 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:34.332456 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:34.332456 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 553/1082] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:34.337846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62380a9e-c50a-4e8e-b690-6c3b15e0d67d None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:34.344307 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 530/1083] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 22 20:27:34 2022] PUT /identity/v3/projects/783c362712d34405ab827e3f00a67995/users/9f1738f72b4848499cdf0ec6866c3c8f/roles/0f0fc9106edb4456b2eafeeb4de00cc2 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:27:34.391152 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:34.459630 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62380a9e-c50a-4e8e-b690-6c3b15e0d67d None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:34.499839 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f6bea-1a13-4790-a7b0-00db87383169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:34.500225 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f6bea-1a13-4790-a7b0-00db87383169 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:34.500433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f6bea-1a13-4790-a7b0-00db87383169 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:34.500730 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f6bea-1a13-4790-a7b0-00db87383169 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:34.501380 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f6bea-1a13-4790-a7b0-00db87383169 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:34.501677 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f6bea-1a13-4790-a7b0-00db87383169 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:34.503032 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f6bea-1a13-4790-a7b0-00db87383169 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:34.516728 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 554/1084] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:35.835221 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6af4ea-5e8b-4d64-a940-3421d34915a9 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:35.835737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6af4ea-5e8b-4d64-a940-3421d34915a9 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:35.835737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6af4ea-5e8b-4d64-a940-3421d34915a9 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:35.837133 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 531/1085] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:35.842852 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd19896-513d-47a8-8dc2-d04c818a848d None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:35.843330 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd19896-513d-47a8-8dc2-d04c818a848d None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:35.843421 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd19896-513d-47a8-8dc2-d04c818a848d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:35.862015 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-9fd19896-513d-47a8-8dc2-d04c818a848d None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:35.863211 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-9fd19896-513d-47a8-8dc2-d04c818a848d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:35.935172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 555/1086] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:27:36.204158 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6af4ea-5e8b-4d64-a940-3421d34915a9 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:36.235577 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f24f0c-bad1-41ad-8636-378fc7966ecd None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:36.235867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f24f0c-bad1-41ad-8636-378fc7966ecd None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:36.236144 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f24f0c-bad1-41ad-8636-378fc7966ecd None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:36.237502 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 556/1087] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:27:36.242410 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef17875-ea5e-4cd4-8d30-5eb55856d8b6 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:36.242688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef17875-ea5e-4cd4-8d30-5eb55856d8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:36.242959 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef17875-ea5e-4cd4-8d30-5eb55856d8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:36.260533 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-2ef17875-ea5e-4cd4-8d30-5eb55856d8b6 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:36.261794 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-2ef17875-ea5e-4cd4-8d30-5eb55856d8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:36.286347 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:36.307535 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6af4ea-5e8b-4d64-a940-3421d34915a9 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:36.329516 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 557/1088] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:27:36.341867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63949ed-e402-423a-88af-29e6e9e79151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:36.343140 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63949ed-e402-423a-88af-29e6e9e79151 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:36.343419 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63949ed-e402-423a-88af-29e6e9e79151 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:36.343689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63949ed-e402-423a-88af-29e6e9e79151 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:36.353661 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63949ed-e402-423a-88af-29e6e9e79151 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:27:36.358378 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-d63949ed-e402-423a-88af-29e6e9e79151 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:27:36.358378 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:36.358378 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:36.358378 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:36.358378 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:36.358378 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:36.358378 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:36.358378 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:36.358378 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:36.358378 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:36.358378 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:36.358378 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:36.358378 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:27:36.358378 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:27:36.358378 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:27:36.358378 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:27:36.359507 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:27:36.359507 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:27:36.359507 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:27:36.359507 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:27:36.359507 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:36.359507 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:36.359507 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:36.359507 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:36.359507 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:36.359507 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:36.359507 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:36.359507 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:36.359507 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:36.359507 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:36.359507 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:36.359507 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:36.360634 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:36.360634 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:36.360634 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:36.360634 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:36.360634 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:27:36.360634 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:27:36.360634 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:27:36.360634 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:27:36.360634 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:27:36.360634 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:27:36.360634 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:27:36.360634 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:36.361338 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 532/1089] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 22 20:27:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:36.365322 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef17875-ea5e-4cd4-8d30-5eb55856d8b6 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:36.462277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef17875-ea5e-4cd4-8d30-5eb55856d8b6 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:36.496218 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb52d4-3fa8-4871-aec0-4fab8392569a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:36.496844 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb52d4-3fa8-4871-aec0-4fab8392569a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:36.497123 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb52d4-3fa8-4871-aec0-4fab8392569a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:36.497394 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb52d4-3fa8-4871-aec0-4fab8392569a None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:36.498045 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb52d4-3fa8-4871-aec0-4fab8392569a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:36.498895 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb52d4-3fa8-4871-aec0-4fab8392569a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:36.500693 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb52d4-3fa8-4871-aec0-4fab8392569a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:36.508501 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 558/1090] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:27:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:36.515255 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63949ed-e402-423a-88af-29e6e9e79151 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:36.546743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:36.593650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb52d4-3fa8-4871-aec0-4fab8392569a None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:36.616612 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63949ed-e402-423a-88af-29e6e9e79151 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:36.618501 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:36.652082 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89978974-9fad-4ac2-a4b9-df805b8983bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:36.652736 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89978974-9fad-4ac2-a4b9-df805b8983bb None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:36.653026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89978974-9fad-4ac2-a4b9-df805b8983bb None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:36.653298 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89978974-9fad-4ac2-a4b9-df805b8983bb None admin] PATH_INFO: `/v3/users/2b6472075f1a47e9841e9774a615dd5e` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:36.654451 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89978974-9fad-4ac2-a4b9-df805b8983bb None admin] RBAC: Authorizing `identity:get_user(user_id=2b6472075f1a47e9841e9774a615dd5e)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:36.655954 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89978974-9fad-4ac2-a4b9-df805b8983bb None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:36.657563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 533/1091] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:27:36 2022] GET /identity/v3/users/2b6472075f1a47e9841e9774a615dd5e => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:36.663547 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89978974-9fad-4ac2-a4b9-df805b8983bb None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:36.695062 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb52d4-3fa8-4871-aec0-4fab8392569a None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:36.732270 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469aed81-4b8b-45ed-8ff9-a1ff90a6f115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:36.733460 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469aed81-4b8b-45ed-8ff9-a1ff90a6f115 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:36.733886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469aed81-4b8b-45ed-8ff9-a1ff90a6f115 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:36.734820 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469aed81-4b8b-45ed-8ff9-a1ff90a6f115 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:36.744650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469aed81-4b8b-45ed-8ff9-a1ff90a6f115 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:27:36.749573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-469aed81-4b8b-45ed-8ff9-a1ff90a6f115 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 20:27:36.749573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:36.749573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:36.749573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:36.749573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:36.749573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:36.749573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:36.749573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:36.749573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:36.749573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:36.749573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:36.749573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:36.749573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:27:36.749573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:27:36.749573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:27:36.749573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:27:36.750543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:27:36.750543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:27:36.750543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:27:36.750543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:27:36.750543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:36.750543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:36.750543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:36.750543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:36.750543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:36.750543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:36.750543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:36.750543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:36.750543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:36.750543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:36.750543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:36.750543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:36.751403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:36.751403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:36.751403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:36.751403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:36.751403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:27:36.751403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:27:36.751403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:27:36.751403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:27:36.751403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:27:36.751403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:27:36.751403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 20:27:36.751403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:36.751403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 559/1092] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Aug 22 20:27:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:27:36.756724 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469aed81-4b8b-45ed-8ff9-a1ff90a6f115 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:36.761538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:36.764822 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89978974-9fad-4ac2-a4b9-df805b8983bb None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:36.802970 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e0d2d-e02c-419e-8eb1-438825ab079d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:36.802970 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e0d2d-e02c-419e-8eb1-438825ab079d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:36.802970 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e0d2d-e02c-419e-8eb1-438825ab079d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:36.802970 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e0d2d-e02c-419e-8eb1-438825ab079d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:36.843285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:36.863005 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469aed81-4b8b-45ed-8ff9-a1ff90a6f115 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:36.874229 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e0d2d-e02c-419e-8eb1-438825ab079d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:36.875698 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e0d2d-e02c-419e-8eb1-438825ab079d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:36.897701 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02532174-31cb-4ef4-bae6-65c57af4568b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:36.898300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02532174-31cb-4ef4-bae6-65c57af4568b None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:36.898579 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02532174-31cb-4ef4-bae6-65c57af4568b None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:36.898855 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02532174-31cb-4ef4-bae6-65c57af4568b None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:36.899539 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02532174-31cb-4ef4-bae6-65c57af4568b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:36.899842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02532174-31cb-4ef4-bae6-65c57af4568b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:36.901268 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02532174-31cb-4ef4-bae6-65c57af4568b None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:36.909862 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 560/1093] 10.222.0.62 () {56 vars in 1115 bytes} [Mon Aug 22 20:27:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:36.915966 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02532174-31cb-4ef4-bae6-65c57af4568b None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:36.976394 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:36.979977 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 534/1094] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:27:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 20:27:36.986339 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e0d2d-e02c-419e-8eb1-438825ab079d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:37.019346 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02532174-31cb-4ef4-bae6-65c57af4568b None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:37.051966 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cdd53e-366e-4889-9898-fdc08c8c2833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:37.052580 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdd53e-366e-4889-9898-fdc08c8c2833 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:37.052884 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdd53e-366e-4889-9898-fdc08c8c2833 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:37.053152 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdd53e-366e-4889-9898-fdc08c8c2833 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:37.063805 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cdd53e-366e-4889-9898-fdc08c8c2833 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:37.065276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cdd53e-366e-4889-9898-fdc08c8c2833 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:37.067736 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:37.079958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-93cdd53e-366e-4889-9898-fdc08c8c2833 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:37.079958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:37.079958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:37.079958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:37.079958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:37.079958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:37.079958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:37.079958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:37.079958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:37.079958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:37.079958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:37.079958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:37.079958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:27:37.079958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:27:37.079958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:27:37.079958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:27:37.082867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:37.082867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:37.082867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:37.082867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:37.082867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:37.082867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:37.082867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:37.082867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:37.082867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:37.082867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:37.082867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:37.082867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:37.082867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:37.082867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:37.082867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:37.082867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:37.082867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:27:37.084231 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:27:37.084231 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:37.084231 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:37.084231 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 561/1095] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:27:37.085226 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e0d2d-e02c-419e-8eb1-438825ab079d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:37.086784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cdd53e-366e-4889-9898-fdc08c8c2833 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:37.120318 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175fd244-d7f9-47c5-80b4-a381e3ec41d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:37.120986 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fd244-d7f9-47c5-80b4-a381e3ec41d7 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:37.121264 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fd244-d7f9-47c5-80b4-a381e3ec41d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:37.121539 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fd244-d7f9-47c5-80b4-a381e3ec41d7 None admin] PATH_INFO: `/v3/projects/e52d6b68dc1e4678abf6e98f46f93844` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:37.122651 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175fd244-d7f9-47c5-80b4-a381e3ec41d7 None admin] RBAC: Authorizing `identity:get_project(project_id=e52d6b68dc1e4678abf6e98f46f93844)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:37.124242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175fd244-d7f9-47c5-80b4-a381e3ec41d7 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:37.125902 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 535/1096] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:27:36 2022] GET /identity/v3/projects/e52d6b68dc1e4678abf6e98f46f93844 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:37.132008 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175fd244-d7f9-47c5-80b4-a381e3ec41d7 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:37.187779 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cdd53e-366e-4889-9898-fdc08c8c2833 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:37.198780 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:37.222534 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b83a5-3b13-49a5-94dd-ede0eb85ab3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:37.223133 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b83a5-3b13-49a5-94dd-ede0eb85ab3c None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:37.223410 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b83a5-3b13-49a5-94dd-ede0eb85ab3c None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:37.223676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b83a5-3b13-49a5-94dd-ede0eb85ab3c None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:37.224297 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b83a5-3b13-49a5-94dd-ede0eb85ab3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:37.224599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b83a5-3b13-49a5-94dd-ede0eb85ab3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:37.225977 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b83a5-3b13-49a5-94dd-ede0eb85ab3c None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:37.233177 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175fd244-d7f9-47c5-80b4-a381e3ec41d7 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:37.238535 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 562/1097] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:37.244155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b83a5-3b13-49a5-94dd-ede0eb85ab3c None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:37.269286 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54078da-5643-4cda-ba51-1897b1f375dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:37.269888 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54078da-5643-4cda-ba51-1897b1f375dc None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:37.270169 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54078da-5643-4cda-ba51-1897b1f375dc None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:37.270449 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54078da-5643-4cda-ba51-1897b1f375dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:37.271172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54078da-5643-4cda-ba51-1897b1f375dc None admin] RBAC: Adding query filter params (role.id=e3faa0474c054da6bb4d8910a4e40bff, scope.project.id=e52d6b68dc1e4678abf6e98f46f93844, user.id=2b6472075f1a47e9841e9774a615dd5e) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:37.271483 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54078da-5643-4cda-ba51-1897b1f375dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:37.272941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54078da-5643-4cda-ba51-1897b1f375dc None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:37.278681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 536/1098] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:27:37 2022] GET /identity/v3/role_assignments?user.id=2b6472075f1a47e9841e9774a615dd5e&scope.project.id=e52d6b68dc1e4678abf6e98f46f93844&role.id=e3faa0474c054da6bb4d8910a4e40bff => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:37.306515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:37.353450 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b83a5-3b13-49a5-94dd-ede0eb85ab3c None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:37.389716 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3716e-2375-46d7-8cc1-a2f620ac2bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:37.390497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3716e-2375-46d7-8cc1-a2f620ac2bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:37.390780 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3716e-2375-46d7-8cc1-a2f620ac2bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:37.391052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3716e-2375-46d7-8cc1-a2f620ac2bb3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:37.399456 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3716e-2375-46d7-8cc1-a2f620ac2bb3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:37.400964 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3716e-2375-46d7-8cc1-a2f620ac2bb3 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:37.413550 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-d0a3716e-2375-46d7-8cc1-a2f620ac2bb3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:27:37.413550 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:37.413550 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:37.413550 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:37.413550 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:37.413550 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:37.413550 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:37.413550 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:37.413550 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:37.413550 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:37.413550 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:37.413550 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:37.413550 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:27:37.413550 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:27:37.413550 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:27:37.413550 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:27:37.414676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:37.414676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:37.414676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:27:37.414676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:27:37.414676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:27:37.414676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:27:37.414676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:37.414676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:37.414676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:37.414676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:37.414676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:37.414676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:37.414676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:37.414676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:37.414676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:37.414676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:37.414676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:37.414676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:37.416109 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:37.416109 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:37.416109 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:27:37.416109 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:27:37.416109 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:27:37.416109 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:27:37.416109 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:27:37.416109 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:27:37.416109 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 20:27:37.416109 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:37.416109 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 563/1099] 10.222.0.62 () {56 vars in 1093 bytes} [Mon Aug 22 20:27:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:27:37.421323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54078da-5643-4cda-ba51-1897b1f375dc None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:37.523353 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54078da-5643-4cda-ba51-1897b1f375dc None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:37.553240 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:37.558168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe142718-b01c-4117-9bec-1f3d1d4b5563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:37.558776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe142718-b01c-4117-9bec-1f3d1d4b5563 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:37.559058 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe142718-b01c-4117-9bec-1f3d1d4b5563 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:37.559332 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe142718-b01c-4117-9bec-1f3d1d4b5563 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:37.560056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe142718-b01c-4117-9bec-1f3d1d4b5563 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:37.560362 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe142718-b01c-4117-9bec-1f3d1d4b5563 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:37.561987 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe142718-b01c-4117-9bec-1f3d1d4b5563 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:37.579548 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 537/1100] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Aug 22 20:27:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:37.585342 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3716e-2375-46d7-8cc1-a2f620ac2bb3 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:37.682785 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3716e-2375-46d7-8cc1-a2f620ac2bb3 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:37.698338 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:37.715795 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da49bb3-940c-4d28-ba9a-67b8bd7f1efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:37.716392 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da49bb3-940c-4d28-ba9a-67b8bd7f1efd None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:37.716689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da49bb3-940c-4d28-ba9a-67b8bd7f1efd None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:37.717858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da49bb3-940c-4d28-ba9a-67b8bd7f1efd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:37.785630 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da49bb3-940c-4d28-ba9a-67b8bd7f1efd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:37.786990 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da49bb3-940c-4d28-ba9a-67b8bd7f1efd None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:37.885770 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 564/1101] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:27:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 20:27:37.891663 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe142718-b01c-4117-9bec-1f3d1d4b5563 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:37.992276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe142718-b01c-4117-9bec-1f3d1d4b5563 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:38.025592 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76b0aa-5fe7-4249-9cc1-ac5e55980b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:38.026215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76b0aa-5fe7-4249-9cc1-ac5e55980b6b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:38.026491 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76b0aa-5fe7-4249-9cc1-ac5e55980b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:38.026762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76b0aa-5fe7-4249-9cc1-ac5e55980b6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:38.037411 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76b0aa-5fe7-4249-9cc1-ac5e55980b6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:38.038793 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba76b0aa-5fe7-4249-9cc1-ac5e55980b6b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:38.054292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-ba76b0aa-5fe7-4249-9cc1-ac5e55980b6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:38.054292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:38.054292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:38.054292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:38.054292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:38.054292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:38.054292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:38.054292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:38.054292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:38.054292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:38.054292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:38.054292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:38.054292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:27:38.054292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:27:38.054292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:27:38.054292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:27:38.055272 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:38.055272 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:38.055272 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:38.055272 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:38.055272 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:38.055272 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:38.055272 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:38.055272 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:38.055272 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:38.055272 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:38.055272 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:38.055272 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:38.055272 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:38.055272 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:38.055272 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:38.055272 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:38.055272 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:27:38.056566 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:27:38.056566 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:27:38.056566 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:38.056566 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 538/1102] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:38.061373 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da49bb3-940c-4d28-ba9a-67b8bd7f1efd None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:38.078898 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:38.160006 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da49bb3-940c-4d28-ba9a-67b8bd7f1efd None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:38.193217 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d8819-0fa4-4b29-ab06-570e84170669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:38.193811 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d8819-0fa4-4b29-ab06-570e84170669 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:38.194089 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d8819-0fa4-4b29-ab06-570e84170669 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:38.194361 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d8819-0fa4-4b29-ab06-570e84170669 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:38.194993 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d8819-0fa4-4b29-ab06-570e84170669 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:38.195292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d8819-0fa4-4b29-ab06-570e84170669 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:38.196645 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d8819-0fa4-4b29-ab06-570e84170669 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:38.208621 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 565/1103] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:38.214140 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76b0aa-5fe7-4249-9cc1-ac5e55980b6b None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:38.257596 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:38.323333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76b0aa-5fe7-4249-9cc1-ac5e55980b6b None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:38.353639 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aed610-f1bf-402a-8108-be301e4fc697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:38.354259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aed610-f1bf-402a-8108-be301e4fc697 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:38.354532 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aed610-f1bf-402a-8108-be301e4fc697 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:38.354797 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aed610-f1bf-402a-8108-be301e4fc697 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:38.361807 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aed610-f1bf-402a-8108-be301e4fc697 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:38.363236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aed610-f1bf-402a-8108-be301e4fc697 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:38.374725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-29aed610-f1bf-402a-8108-be301e4fc697 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:27:38.374725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:38.374725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:38.374725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:38.374725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:38.374725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:38.374725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:38.374725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:38.374725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:38.374725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:38.374725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:38.374725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:38.374725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:27:38.374725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:27:38.374725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:27:38.375609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:27:38.375609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:38.375609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:38.375609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:38.375609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:38.375609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:38.375609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:38.375609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:38.375609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:38.375609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:38.375609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:38.375609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:38.375609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:38.375609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:38.375609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:38.375609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:38.375609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:38.376493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:27:38.376493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:27:38.376493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:27:38.376493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:27:38.376493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:27:38.376493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:27:38.376493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:27:38.376493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:27:38.376493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 539/1104] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:27:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:38.381932 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d8819-0fa4-4b29-ab06-570e84170669 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:38.459654 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:38.481282 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d8819-0fa4-4b29-ab06-570e84170669 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:38.514985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90cbcd-62f0-4809-acfd-4c1a41cad4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:38.515580 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90cbcd-62f0-4809-acfd-4c1a41cad4c2 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:38.515852 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90cbcd-62f0-4809-acfd-4c1a41cad4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:38.516117 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90cbcd-62f0-4809-acfd-4c1a41cad4c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:38.516836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90cbcd-62f0-4809-acfd-4c1a41cad4c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:38.517134 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90cbcd-62f0-4809-acfd-4c1a41cad4c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:38.518551 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90cbcd-62f0-4809-acfd-4c1a41cad4c2 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:38.535204 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 566/1105] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 22 20:27:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:38.536748 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aed610-f1bf-402a-8108-be301e4fc697 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:38.635266 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aed610-f1bf-402a-8108-be301e4fc697 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:38.638831 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:38.669273 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad262fe-a1bf-4563-bfa8-f965c44bfccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:38.669870 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad262fe-a1bf-4563-bfa8-f965c44bfccf None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:38.670749 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad262fe-a1bf-4563-bfa8-f965c44bfccf None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:38.671117 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad262fe-a1bf-4563-bfa8-f965c44bfccf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:38.671883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad262fe-a1bf-4563-bfa8-f965c44bfccf None admin] RBAC: Adding query filter params (role.id=0f0fc9106edb4456b2eafeeb4de00cc2, scope.project.id=783c362712d34405ab827e3f00a67995, user.id=9f1738f72b4848499cdf0ec6866c3c8f) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:38.672184 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad262fe-a1bf-4563-bfa8-f965c44bfccf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:38.673643 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad262fe-a1bf-4563-bfa8-f965c44bfccf None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:38.680799 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 540/1106] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:27:38 2022] GET /identity/v3/role_assignments?user.id=9f1738f72b4848499cdf0ec6866c3c8f&scope.project.id=783c362712d34405ab827e3f00a67995&role.id=0f0fc9106edb4456b2eafeeb4de00cc2 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:39.254418 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad1a2b-2f79-484c-817f-762f8c0f80a3 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:39.254940 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad1a2b-2f79-484c-817f-762f8c0f80a3 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:39.254940 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad1a2b-2f79-484c-817f-762f8c0f80a3 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:39.256273 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 567/1107] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:39.261787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684e0c4-e64a-46a2-b092-37020640020f None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:39.262197 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684e0c4-e64a-46a2-b092-37020640020f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:39.262370 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684e0c4-e64a-46a2-b092-37020640020f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:39.280994 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-2684e0c4-e64a-46a2-b092-37020640020f None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:39.282200 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2684e0c4-e64a-46a2-b092-37020640020f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:39.350327 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 541/1108] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:27:39.623915 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad1a2b-2f79-484c-817f-762f8c0f80a3 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:39.723959 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad1a2b-2f79-484c-817f-762f8c0f80a3 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:39.758508 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960dbbf0-d2a5-49ac-8a31-8e4755a3b935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:39.759119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960dbbf0-d2a5-49ac-8a31-8e4755a3b935 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:39.759397 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960dbbf0-d2a5-49ac-8a31-8e4755a3b935 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:39.759668 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960dbbf0-d2a5-49ac-8a31-8e4755a3b935 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:39.760790 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960dbbf0-d2a5-49ac-8a31-8e4755a3b935 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:39.762218 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960dbbf0-d2a5-49ac-8a31-8e4755a3b935 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:39.763808 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 568/1109] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:39.769622 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684e0c4-e64a-46a2-b092-37020640020f None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:39.862684 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:39.868242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684e0c4-e64a-46a2-b092-37020640020f None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:39.901236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c66887-52c9-4f41-a421-1765f89a4490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:39.901876 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c66887-52c9-4f41-a421-1765f89a4490 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:39.902331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c66887-52c9-4f41-a421-1765f89a4490 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:39.902962 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c66887-52c9-4f41-a421-1765f89a4490 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:39.903702 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c66887-52c9-4f41-a421-1765f89a4490 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:39.905882 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c66887-52c9-4f41-a421-1765f89a4490 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:39.992821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 542/1110] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Aug 22 20:27:39 2022] POST /identity/v3/users => generated 286 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:27:41.895567 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b0d37-86e2-4621-8817-cc6d0d0cd73d None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:41.896115 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b0d37-86e2-4621-8817-cc6d0d0cd73d None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:41.896115 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b0d37-86e2-4621-8817-cc6d0d0cd73d None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:41.897601 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 569/1111] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:41.902886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87763f22-159d-481d-a472-905a8445877d None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:41.903312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87763f22-159d-481d-a472-905a8445877d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:41.903436 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87763f22-159d-481d-a472-905a8445877d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:41.921112 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-87763f22-159d-481d-a472-905a8445877d None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:41.922280 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-87763f22-159d-481d-a472-905a8445877d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:41.986912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 543/1112] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:27:42.255263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b0d37-86e2-4621-8817-cc6d0d0cd73d None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:42.259126 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:42.353776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b0d37-86e2-4621-8817-cc6d0d0cd73d None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:42.386503 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349bd9d0-0a05-4865-976b-922d08035e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:42.387112 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349bd9d0-0a05-4865-976b-922d08035e74 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:42.387386 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349bd9d0-0a05-4865-976b-922d08035e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:42.387653 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349bd9d0-0a05-4865-976b-922d08035e74 None admin] PATH_INFO: `/v3/roles/7f4b8cdb739c4f808ef31961eb11510e` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:42.389132 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349bd9d0-0a05-4865-976b-922d08035e74 None admin] RBAC: Authorizing `identity:get_role(role_id=7f4b8cdb739c4f808ef31961eb11510e)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:42.390485 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349bd9d0-0a05-4865-976b-922d08035e74 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:42.391771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 570/1113] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:27:42 2022] GET /identity/v3/roles/7f4b8cdb739c4f808ef31961eb11510e => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:42.397714 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87763f22-159d-481d-a472-905a8445877d None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:42.477726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:42.495329 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87763f22-159d-481d-a472-905a8445877d None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:42.527843 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e5bfc-5bcc-4a52-a02c-6a6c9289b11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:42.528395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e5bfc-5bcc-4a52-a02c-6a6c9289b11c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:42.528731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e5bfc-5bcc-4a52-a02c-6a6c9289b11c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:42.529503 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e5bfc-5bcc-4a52-a02c-6a6c9289b11c None admin] PATH_INFO: `/v3/users/6584a350f83f43f6aa09d4647a30f4a6` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:42.542068 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e5bfc-5bcc-4a52-a02c-6a6c9289b11c None admin] RBAC: Authorizing `identity:get_user(user_id=6584a350f83f43f6aa09d4647a30f4a6)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:42.543498 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e5bfc-5bcc-4a52-a02c-6a6c9289b11c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:42.546133 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 544/1114] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:27:42 2022] GET /identity/v3/users/6584a350f83f43f6aa09d4647a30f4a6 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:42.551643 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349bd9d0-0a05-4865-976b-922d08035e74 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:42.620577 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:42.650849 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349bd9d0-0a05-4865-976b-922d08035e74 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:42.686191 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b11c1-3e7f-4c0b-a288-dfe944627cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:42.686787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b11c1-3e7f-4c0b-a288-dfe944627cee None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:42.687066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b11c1-3e7f-4c0b-a288-dfe944627cee None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:42.687334 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b11c1-3e7f-4c0b-a288-dfe944627cee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:42.753659 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b11c1-3e7f-4c0b-a288-dfe944627cee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:42.755098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b11c1-3e7f-4c0b-a288-dfe944627cee None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:42.823303 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:42.853738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 571/1115] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:27:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 20:27:42.860355 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e5bfc-5bcc-4a52-a02c-6a6c9289b11c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:42.957488 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e5bfc-5bcc-4a52-a02c-6a6c9289b11c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:42.991168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e7f94-2c5d-4f25-b64e-e80908ed4b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:42.991787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e7f94-2c5d-4f25-b64e-e80908ed4b8c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:42.992069 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e7f94-2c5d-4f25-b64e-e80908ed4b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:42.992344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e7f94-2c5d-4f25-b64e-e80908ed4b8c None admin] PATH_INFO: `/v3/projects/e52d6b68dc1e4678abf6e98f46f93844` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:42.993482 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e7f94-2c5d-4f25-b64e-e80908ed4b8c None admin] RBAC: Authorizing `identity:get_project(project_id=e52d6b68dc1e4678abf6e98f46f93844)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:42.994931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e7f94-2c5d-4f25-b64e-e80908ed4b8c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:42.996541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 545/1116] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:27:42 2022] GET /identity/v3/projects/e52d6b68dc1e4678abf6e98f46f93844 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:43.003016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b11c1-3e7f-4c0b-a288-dfe944627cee None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:43.101020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b11c1-3e7f-4c0b-a288-dfe944627cee None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:43.134032 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8d577-669b-4a3f-8a50-a5bb2eea9388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:43.134629 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8d577-669b-4a3f-8a50-a5bb2eea9388 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:43.134928 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8d577-669b-4a3f-8a50-a5bb2eea9388 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:43.135185 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8d577-669b-4a3f-8a50-a5bb2eea9388 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:43.135903 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8d577-669b-4a3f-8a50-a5bb2eea9388 None admin] RBAC: Adding query filter params (role.id=7f4b8cdb739c4f808ef31961eb11510e, scope.project.id=e52d6b68dc1e4678abf6e98f46f93844, user.id=6584a350f83f43f6aa09d4647a30f4a6) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:43.136210 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8d577-669b-4a3f-8a50-a5bb2eea9388 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:43.137670 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8d577-669b-4a3f-8a50-a5bb2eea9388 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:43.143669 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 572/1117] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:27:43 2022] GET /identity/v3/role_assignments?user.id=6584a350f83f43f6aa09d4647a30f4a6&scope.project.id=e52d6b68dc1e4678abf6e98f46f93844&role.id=7f4b8cdb739c4f808ef31961eb11510e => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:27:45.021862 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4c94d-0a57-4870-b03a-244c2ce24720 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:45.022498 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4c94d-0a57-4870-b03a-244c2ce24720 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:45.022498 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4c94d-0a57-4870-b03a-244c2ce24720 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:45.023734 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 546/1118] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:45.029509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980c7a6-5496-498e-91f3-049ad8423fed None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:45.035056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980c7a6-5496-498e-91f3-049ad8423fed None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:45.035056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b980c7a6-5496-498e-91f3-049ad8423fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:45.048068 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-b980c7a6-5496-498e-91f3-049ad8423fed None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:45.049236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b980c7a6-5496-498e-91f3-049ad8423fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:45.077910 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:45.116119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 573/1119] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:27:45.390840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4c94d-0a57-4870-b03a-244c2ce24720 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:45.401806 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:45.492183 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4c94d-0a57-4870-b03a-244c2ce24720 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:45.525882 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27cae3-c05d-4dbc-a0e4-073f9483bce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:45.526498 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27cae3-c05d-4dbc-a0e4-073f9483bce7 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:45.526779 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27cae3-c05d-4dbc-a0e4-073f9483bce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:45.527054 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27cae3-c05d-4dbc-a0e4-073f9483bce7 None admin] PATH_INFO: `/v3/roles/7f4b8cdb739c4f808ef31961eb11510e` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:45.528432 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27cae3-c05d-4dbc-a0e4-073f9483bce7 None admin] RBAC: Authorizing `identity:get_role(role_id=7f4b8cdb739c4f808ef31961eb11510e)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:45.530168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27cae3-c05d-4dbc-a0e4-073f9483bce7 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:45.531465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 547/1120] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:27:45 2022] GET /identity/v3/roles/7f4b8cdb739c4f808ef31961eb11510e => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:45.537313 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b980c7a6-5496-498e-91f3-049ad8423fed None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:45.633580 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b980c7a6-5496-498e-91f3-049ad8423fed None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:45.666400 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9eb39-9035-494d-82f2-e737f76f1cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:45.666959 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9eb39-9035-494d-82f2-e737f76f1cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:45.667236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9eb39-9035-494d-82f2-e737f76f1cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:45.667504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9eb39-9035-494d-82f2-e737f76f1cb7 None admin] PATH_INFO: `/v3/users/6584a350f83f43f6aa09d4647a30f4a6` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:45.668600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9eb39-9035-494d-82f2-e737f76f1cb7 None admin] RBAC: Authorizing `identity:get_user(user_id=6584a350f83f43f6aa09d4647a30f4a6)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:45.670322 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9eb39-9035-494d-82f2-e737f76f1cb7 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:45.671875 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 574/1121] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:27:45 2022] GET /identity/v3/users/6584a350f83f43f6aa09d4647a30f4a6 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:45.677617 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27cae3-c05d-4dbc-a0e4-073f9483bce7 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:45.754711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:45.777223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27cae3-c05d-4dbc-a0e4-073f9483bce7 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:45.811375 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbfa016-4b8e-4166-8164-19255bf7fdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:45.811990 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfa016-4b8e-4166-8164-19255bf7fdbd None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:45.812264 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfa016-4b8e-4166-8164-19255bf7fdbd None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:45.812532 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfa016-4b8e-4166-8164-19255bf7fdbd None admin] PATH_INFO: `/v3/projects/e52d6b68dc1e4678abf6e98f46f93844` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:45.813714 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbfa016-4b8e-4166-8164-19255bf7fdbd None admin] RBAC: Authorizing `identity:get_project(project_id=e52d6b68dc1e4678abf6e98f46f93844)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:45.815139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbfa016-4b8e-4166-8164-19255bf7fdbd None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:45.816767 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 548/1122] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:27:45 2022] GET /identity/v3/projects/e52d6b68dc1e4678abf6e98f46f93844 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:45.822871 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9eb39-9035-494d-82f2-e737f76f1cb7 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:45.856427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:45.919280 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9eb39-9035-494d-82f2-e737f76f1cb7 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:45.952514 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d9818-6ae3-4c9d-8b81-df9f94420bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:45.953180 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d9818-6ae3-4c9d-8b81-df9f94420bfe None admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:45.953458 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d9818-6ae3-4c9d-8b81-df9f94420bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:45.953725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d9818-6ae3-4c9d-8b81-df9f94420bfe None admin] PATH_INFO: `/v3/projects/e52d6b68dc1e4678abf6e98f46f93844/users/6584a350f83f43f6aa09d4647a30f4a6/roles/7f4b8cdb739c4f808ef31961eb11510e` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:45.955946 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d9818-6ae3-4c9d-8b81-df9f94420bfe None admin] RBAC: Authorizing `identity:create_grant(project_id=e52d6b68dc1e4678abf6e98f46f93844, user_id=6584a350f83f43f6aa09d4647a30f4a6, role_id=7f4b8cdb739c4f808ef31961eb11510e)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:45.957396 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d9818-6ae3-4c9d-8b81-df9f94420bfe None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:46.026164 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 575/1123] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 22 20:27:45 2022] PUT /identity/v3/projects/e52d6b68dc1e4678abf6e98f46f93844/users/6584a350f83f43f6aa09d4647a30f4a6/roles/7f4b8cdb739c4f808ef31961eb11510e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:27:47.881610 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7fdd3-70fb-428a-abf3-cf958c767500 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:47.882142 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7fdd3-70fb-428a-abf3-cf958c767500 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:47.882142 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7fdd3-70fb-428a-abf3-cf958c767500 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:47.883482 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 549/1124] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:47.889383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed8ced-f4e9-4735-a0d3-0a46d0c813a9 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:47.889799 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed8ced-f4e9-4735-a0d3-0a46d0c813a9 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:47.889930 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed8ced-f4e9-4735-a0d3-0a46d0c813a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:47.907521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-87ed8ced-f4e9-4735-a0d3-0a46d0c813a9 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:47.908725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-87ed8ced-f4e9-4735-a0d3-0a46d0c813a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:47.981870 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 576/1125] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:27:48.255382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7fdd3-70fb-428a-abf3-cf958c767500 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:48.355074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7fdd3-70fb-428a-abf3-cf958c767500 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:48.388920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6ee22-1650-4680-8505-1828f11f93fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:48.389532 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6ee22-1650-4680-8505-1828f11f93fd None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:48.389811 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6ee22-1650-4680-8505-1828f11f93fd None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:48.390085 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6ee22-1650-4680-8505-1828f11f93fd None admin] PATH_INFO: `/v3/roles/7f4b8cdb739c4f808ef31961eb11510e` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:48.391473 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6ee22-1650-4680-8505-1828f11f93fd None admin] RBAC: Authorizing `identity:get_role(role_id=7f4b8cdb739c4f808ef31961eb11510e)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:48.392940 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6ee22-1650-4680-8505-1828f11f93fd None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:48.394239 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 550/1126] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:27:48 2022] GET /identity/v3/roles/7f4b8cdb739c4f808ef31961eb11510e => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:48.400034 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed8ced-f4e9-4735-a0d3-0a46d0c813a9 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:48.424535 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:48.497401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed8ced-f4e9-4735-a0d3-0a46d0c813a9 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:48.531611 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5daee-27e7-43a1-97e8-06fa1e582b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:48.532172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5daee-27e7-43a1-97e8-06fa1e582b94 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:48.532451 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5daee-27e7-43a1-97e8-06fa1e582b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:48.532752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5daee-27e7-43a1-97e8-06fa1e582b94 None admin] PATH_INFO: `/v3/users/6584a350f83f43f6aa09d4647a30f4a6` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:48.533864 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5daee-27e7-43a1-97e8-06fa1e582b94 None admin] RBAC: Authorizing `identity:get_user(user_id=6584a350f83f43f6aa09d4647a30f4a6)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:48.535298 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5daee-27e7-43a1-97e8-06fa1e582b94 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:48.536863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 577/1127] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:27:48 2022] GET /identity/v3/users/6584a350f83f43f6aa09d4647a30f4a6 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:48.542639 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6ee22-1650-4680-8505-1828f11f93fd None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:48.558012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:48.642679 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6ee22-1650-4680-8505-1828f11f93fd None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:48.677451 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce141c-7eb2-4176-a5f0-6483211f80e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:48.678060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce141c-7eb2-4176-a5f0-6483211f80e7 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:48.678339 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce141c-7eb2-4176-a5f0-6483211f80e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:48.678611 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce141c-7eb2-4176-a5f0-6483211f80e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:48.744952 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce141c-7eb2-4176-a5f0-6483211f80e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:48.746425 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce141c-7eb2-4176-a5f0-6483211f80e7 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:48.759492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:48.844222 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 551/1128] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:27:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 20:27:48.850172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5daee-27e7-43a1-97e8-06fa1e582b94 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:48.938009 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:48.946528 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5daee-27e7-43a1-97e8-06fa1e582b94 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:48.979919 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd05382-c722-4e37-9bd8-2c8ac0345288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:48.980535 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd05382-c722-4e37-9bd8-2c8ac0345288 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:48.980851 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd05382-c722-4e37-9bd8-2c8ac0345288 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:48.981125 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd05382-c722-4e37-9bd8-2c8ac0345288 None admin] PATH_INFO: `/v3/projects/e52d6b68dc1e4678abf6e98f46f93844` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:48.983010 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd05382-c722-4e37-9bd8-2c8ac0345288 None admin] RBAC: Authorizing `identity:get_project(project_id=e52d6b68dc1e4678abf6e98f46f93844)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:48.984427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd05382-c722-4e37-9bd8-2c8ac0345288 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:48.986064 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 578/1129] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:27:48 2022] GET /identity/v3/projects/e52d6b68dc1e4678abf6e98f46f93844 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:48.992123 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce141c-7eb2-4176-a5f0-6483211f80e7 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:49.090832 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce141c-7eb2-4176-a5f0-6483211f80e7 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:49.103604 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:49.125026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a40b044-bc87-4d9f-898e-ef85bbba7a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:49.125617 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40b044-bc87-4d9f-898e-ef85bbba7a21 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:49.125900 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40b044-bc87-4d9f-898e-ef85bbba7a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:49.126172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40b044-bc87-4d9f-898e-ef85bbba7a21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:49.126891 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a40b044-bc87-4d9f-898e-ef85bbba7a21 None admin] RBAC: Adding query filter params (role.id=7f4b8cdb739c4f808ef31961eb11510e, scope.project.id=e52d6b68dc1e4678abf6e98f46f93844, user.id=6584a350f83f43f6aa09d4647a30f4a6) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:49.127197 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a40b044-bc87-4d9f-898e-ef85bbba7a21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:49.128628 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a40b044-bc87-4d9f-898e-ef85bbba7a21 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:49.134755 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 552/1130] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:27:48 2022] GET /identity/v3/role_assignments?user.id=6584a350f83f43f6aa09d4647a30f4a6&scope.project.id=e52d6b68dc1e4678abf6e98f46f93844&role.id=7f4b8cdb739c4f808ef31961eb11510e => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:51.062125 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b5c4a-8285-4ebf-86ae-bb6ff2f7e41e None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:51.062612 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b5c4a-8285-4ebf-86ae-bb6ff2f7e41e None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:51.062612 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b5c4a-8285-4ebf-86ae-bb6ff2f7e41e None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:51.063911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 579/1131] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:51.069161 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b25cab-e8fe-48ac-a5ac-4e4cf4d96602 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:51.069576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b25cab-e8fe-48ac-a5ac-4e4cf4d96602 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:51.069711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b25cab-e8fe-48ac-a5ac-4e4cf4d96602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:51.088335 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-62b25cab-e8fe-48ac-a5ac-4e4cf4d96602 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:51.089561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-62b25cab-e8fe-48ac-a5ac-4e4cf4d96602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:51.154442 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 553/1132] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:27:51.439215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b5c4a-8285-4ebf-86ae-bb6ff2f7e41e None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:51.540206 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b5c4a-8285-4ebf-86ae-bb6ff2f7e41e None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:51.574358 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ec55b-3726-40a0-8037-920e1135820a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:51.574965 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ec55b-3726-40a0-8037-920e1135820a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:51.575731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ec55b-3726-40a0-8037-920e1135820a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:51.576007 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ec55b-3726-40a0-8037-920e1135820a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:51.577137 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ec55b-3726-40a0-8037-920e1135820a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:51.578570 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ec55b-3726-40a0-8037-920e1135820a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:51.580090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 580/1133] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:51.585839 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b25cab-e8fe-48ac-a5ac-4e4cf4d96602 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:51.684445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b25cab-e8fe-48ac-a5ac-4e4cf4d96602 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:51.691724 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:51.718419 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201cd3d-82b7-4f06-94c5-6d97935aa2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:51.719018 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201cd3d-82b7-4f06-94c5-6d97935aa2a2 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:51.719295 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201cd3d-82b7-4f06-94c5-6d97935aa2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:51.719567 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201cd3d-82b7-4f06-94c5-6d97935aa2a2 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:51.720303 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3201cd3d-82b7-4f06-94c5-6d97935aa2a2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:51.721777 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3201cd3d-82b7-4f06-94c5-6d97935aa2a2 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:51.834654 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 554/1134] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Aug 22 20:27:51 2022] POST /identity/v3/projects => generated 311 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:27:53.753927 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604cd8e8-6d11-4bfa-b034-244ee18b377f None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:53.754491 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604cd8e8-6d11-4bfa-b034-244ee18b377f None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:53.754491 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604cd8e8-6d11-4bfa-b034-244ee18b377f None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:53.755875 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 581/1135] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:53.761172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c1e39-ce68-474d-b0ca-f76df1ce2c15 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:53.761605 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c1e39-ce68-474d-b0ca-f76df1ce2c15 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:53.761728 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c1e39-ce68-474d-b0ca-f76df1ce2c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:53.780048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-368c1e39-ce68-474d-b0ca-f76df1ce2c15 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:53.781271 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-368c1e39-ce68-474d-b0ca-f76df1ce2c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:53.847231 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 555/1136] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:27:54.115621 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604cd8e8-6d11-4bfa-b034-244ee18b377f None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:54.143773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:54.214734 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604cd8e8-6d11-4bfa-b034-244ee18b377f None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:54.248588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ff14e-0fa2-4de5-8759-394af693f4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:54.249236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ff14e-0fa2-4de5-8759-394af693f4bb None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:54.249517 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ff14e-0fa2-4de5-8759-394af693f4bb None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:54.249791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ff14e-0fa2-4de5-8759-394af693f4bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:54.250956 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ff14e-0fa2-4de5-8759-394af693f4bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:54.252395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ff14e-0fa2-4de5-8759-394af693f4bb None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:54.253978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 582/1137] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:27:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:54.259708 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c1e39-ce68-474d-b0ca-f76df1ce2c15 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:54.345089 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:54.356621 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c1e39-ce68-474d-b0ca-f76df1ce2c15 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:54.390061 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24536599-f3e8-4dd0-b41f-6343a3692ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:54.390657 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24536599-f3e8-4dd0-b41f-6343a3692ac7 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:54.390930 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24536599-f3e8-4dd0-b41f-6343a3692ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:54.391196 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24536599-f3e8-4dd0-b41f-6343a3692ac7 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:54.391837 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24536599-f3e8-4dd0-b41f-6343a3692ac7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:54.393293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24536599-f3e8-4dd0-b41f-6343a3692ac7 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:54.472572 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 556/1138] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Aug 22 20:27:54 2022] POST /identity/v3/users => generated 286 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:27:56.416123 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422fdf9-351e-494a-b8d4-51b2c604352f None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:56.416713 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422fdf9-351e-494a-b8d4-51b2c604352f None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:56.416713 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422fdf9-351e-494a-b8d4-51b2c604352f None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:56.418041 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 583/1139] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:56.423248 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e4b49-dbd2-4a4d-9ad8-fde1c0da9c6e None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:56.423685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e4b49-dbd2-4a4d-9ad8-fde1c0da9c6e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:56.423786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e4b49-dbd2-4a4d-9ad8-fde1c0da9c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:56.441426 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-bd6e4b49-dbd2-4a4d-9ad8-fde1c0da9c6e None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:56.442597 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-bd6e4b49-dbd2-4a4d-9ad8-fde1c0da9c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:56.506931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 557/1140] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:27:56.787288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422fdf9-351e-494a-b8d4-51b2c604352f None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:56.879522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:56.885833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422fdf9-351e-494a-b8d4-51b2c604352f None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:56.918002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb508f4-9fe8-47af-8d67-522b117657be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:56.918658 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb508f4-9fe8-47af-8d67-522b117657be None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:56.919085 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb508f4-9fe8-47af-8d67-522b117657be None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:56.919372 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb508f4-9fe8-47af-8d67-522b117657be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:56.929609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb508f4-9fe8-47af-8d67-522b117657be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:27:56.934885 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-eeb508f4-9fe8-47af-8d67-522b117657be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:27:56.934885 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:27:56.934885 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:27:56.934885 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:27:56.934885 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:27:56.934885 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:27:56.934885 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:27:56.934885 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:27:56.934885 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:27:56.934885 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:27:56.934885 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:27:56.934885 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:27:56.934885 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:27:56.934885 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:27:56.934885 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:27:56.934885 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:27:56.936048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:27:56.936048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:27:56.936048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:27:56.936048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:27:56.936048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:27:56.936048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:27:56.936048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:27:56.936048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:27:56.936048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:27:56.936048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:27:56.936048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:27:56.936048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:27:56.936048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:27:56.936048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:27:56.936048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:27:56.936048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:27:56.937448 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:27:56.937448 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:27:56.937448 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:27:56.937448 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:27:56.937448 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:27:56.937448 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:27:56.937448 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:27:56.937448 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:27:56.937448 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:27:56.937448 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:27:56.937448 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:27:56.937448 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:27:56.937448 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 584/1141] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 22 20:27:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:27:56.941989 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e4b49-dbd2-4a4d-9ad8-fde1c0da9c6e None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:57.014543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:57.038129 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e4b49-dbd2-4a4d-9ad8-fde1c0da9c6e None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:57.072678 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf843a-ab12-4cf5-8a4a-777eba55dfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:57.073271 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf843a-ab12-4cf5-8a4a-777eba55dfb0 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:57.073546 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf843a-ab12-4cf5-8a4a-777eba55dfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:57.073814 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf843a-ab12-4cf5-8a4a-777eba55dfb0 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:57.074463 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf843a-ab12-4cf5-8a4a-777eba55dfb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:57.075500 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf843a-ab12-4cf5-8a4a-777eba55dfb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:57.076907 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf843a-ab12-4cf5-8a4a-777eba55dfb0 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:57.084623 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 558/1142] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:27:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:57.090628 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb508f4-9fe8-47af-8d67-522b117657be None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:57.187708 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb508f4-9fe8-47af-8d67-522b117657be None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:57.220116 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb726a-dbf4-42f9-b222-452c4788dbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:57.220745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb726a-dbf4-42f9-b222-452c4788dbda None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:57.221025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb726a-dbf4-42f9-b222-452c4788dbda None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:57.221292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb726a-dbf4-42f9-b222-452c4788dbda None admin] PATH_INFO: `/v3/users/b60f25f66e094231aaf30eb37a86f456` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:57.235145 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb726a-dbf4-42f9-b222-452c4788dbda None admin] RBAC: Authorizing `identity:get_user(user_id=b60f25f66e094231aaf30eb37a86f456)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:57.236572 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb726a-dbf4-42f9-b222-452c4788dbda None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:57.238146 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 585/1143] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:27:57 2022] GET /identity/v3/users/b60f25f66e094231aaf30eb37a86f456 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:57.244127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf843a-ab12-4cf5-8a4a-777eba55dfb0 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:57.341637 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf843a-ab12-4cf5-8a4a-777eba55dfb0 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:57.374422 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e7ba3-1e1c-47b2-bd14-56ca2bb2ac1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:57.375048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e7ba3-1e1c-47b2-bd14-56ca2bb2ac1e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:57.375326 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e7ba3-1e1c-47b2-bd14-56ca2bb2ac1e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:57.375599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3e7ba3-1e1c-47b2-bd14-56ca2bb2ac1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:57.378904 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:57.439994 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e7ba3-1e1c-47b2-bd14-56ca2bb2ac1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:57.441476 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3e7ba3-1e1c-47b2-bd14-56ca2bb2ac1e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:57.538316 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 559/1144] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:27:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 20:27:57.545192 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb726a-dbf4-42f9-b222-452c4788dbda None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:57.560856 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:57.642869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb726a-dbf4-42f9-b222-452c4788dbda None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:57.676239 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd7df5-6521-436d-8fe0-d3b1309bfcec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:57.676887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd7df5-6521-436d-8fe0-d3b1309bfcec None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:57.677170 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd7df5-6521-436d-8fe0-d3b1309bfcec None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:57.677447 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd7df5-6521-436d-8fe0-d3b1309bfcec None admin] PATH_INFO: `/v3/projects/9d9eebe229c84a6780e357a0298a648d` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:57.678552 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd7df5-6521-436d-8fe0-d3b1309bfcec None admin] RBAC: Authorizing `identity:get_project(project_id=9d9eebe229c84a6780e357a0298a648d)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:57.679967 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd7df5-6521-436d-8fe0-d3b1309bfcec None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:57.681587 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 586/1145] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:27:57 2022] GET /identity/v3/projects/9d9eebe229c84a6780e357a0298a648d => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:57.687652 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e7ba3-1e1c-47b2-bd14-56ca2bb2ac1e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:27:57.720999 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:27:57.788146 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3e7ba3-1e1c-47b2-bd14-56ca2bb2ac1e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:27:57.822526 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191182e5-3f1b-4b96-87d6-c62230116028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:27:57.823122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191182e5-3f1b-4b96-87d6-c62230116028 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:57.823393 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191182e5-3f1b-4b96-87d6-c62230116028 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:57.823658 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191182e5-3f1b-4b96-87d6-c62230116028 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:57.824366 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191182e5-3f1b-4b96-87d6-c62230116028 None admin] RBAC: Adding query filter params (role.id=e3faa0474c054da6bb4d8910a4e40bff, scope.project.id=9d9eebe229c84a6780e357a0298a648d, user.id=b60f25f66e094231aaf30eb37a86f456) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:27:57.824691 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191182e5-3f1b-4b96-87d6-c62230116028 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:27:57.826134 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191182e5-3f1b-4b96-87d6-c62230116028 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:27:57.831252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 560/1146] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:27:57 2022] GET /identity/v3/role_assignments?user.id=b60f25f66e094231aaf30eb37a86f456&scope.project.id=9d9eebe229c84a6780e357a0298a648d&role.id=e3faa0474c054da6bb4d8910a4e40bff => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:27:59.710934 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527828d4-e2c7-4560-b8c1-cbb8b74c4052 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:59.711494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527828d4-e2c7-4560-b8c1-cbb8b74c4052 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:59.711494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527828d4-e2c7-4560-b8c1-cbb8b74c4052 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:59.712820 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 587/1147] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:27:59.718666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ac413-9c08-4713-826d-f631ba20f3ed None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:27:59.719069 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ac413-9c08-4713-826d-f631ba20f3ed None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:27:59.719208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ac413-9c08-4713-826d-f631ba20f3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:27:59.740398 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-b87ac413-9c08-4713-826d-f631ba20f3ed None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:27:59.741626 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b87ac413-9c08-4713-826d-f631ba20f3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:27:59.811505 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 561/1148] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:27:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:28:00.102058 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527828d4-e2c7-4560-b8c1-cbb8b74c4052 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:00.185223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:00.203894 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527828d4-e2c7-4560-b8c1-cbb8b74c4052 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:00.237811 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10e06e-01dd-4e48-9077-72107ead6e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:00.238431 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10e06e-01dd-4e48-9077-72107ead6e30 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:00.238709 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10e06e-01dd-4e48-9077-72107ead6e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:00.238981 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10e06e-01dd-4e48-9077-72107ead6e30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:00.249565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10e06e-01dd-4e48-9077-72107ead6e30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:00.254168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-be10e06e-01dd-4e48-9077-72107ead6e30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:28:00.254168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:00.254168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:00.254168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:00.254168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:00.254168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:00.254168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:00.254168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:00.254168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:00.254168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:00.254168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:00.254168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:00.254168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:00.254168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:00.254168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:00.254168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:00.255288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:00.255288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:00.255288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:00.255288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:00.255288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:00.255288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:00.255288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:00.255288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:00.255288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:00.255288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:00.255288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:00.255288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:00.255288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:00.255288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:00.255288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:00.255288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:00.256160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:00.256160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:00.256160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:00.256160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:00.256160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:00.256160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:00.256160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:00.256160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:00.256160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:00.256160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:00.256160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:28:00.256160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:28:00.256160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 588/1149] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 22 20:28:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:00.261423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ac413-9c08-4713-826d-f631ba20f3ed None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:00.290049 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:00.358859 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ac413-9c08-4713-826d-f631ba20f3ed None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:00.391719 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e30b93-dcd8-4876-ae51-f8bd592f73a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:00.392312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e30b93-dcd8-4876-ae51-f8bd592f73a5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:00.392590 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e30b93-dcd8-4876-ae51-f8bd592f73a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:00.392886 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e30b93-dcd8-4876-ae51-f8bd592f73a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:00.393539 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e30b93-dcd8-4876-ae51-f8bd592f73a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:00.393838 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e30b93-dcd8-4876-ae51-f8bd592f73a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:00.395203 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e30b93-dcd8-4876-ae51-f8bd592f73a5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:00.403038 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 562/1150] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:28:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:00.408904 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10e06e-01dd-4e48-9077-72107ead6e30 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:00.507115 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10e06e-01dd-4e48-9077-72107ead6e30 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:00.539869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe32750-366c-4835-b196-3327030b789b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:00.540482 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe32750-366c-4835-b196-3327030b789b None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:00.540787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe32750-366c-4835-b196-3327030b789b None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:00.541062 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe32750-366c-4835-b196-3327030b789b None admin] PATH_INFO: `/v3/users/b60f25f66e094231aaf30eb37a86f456` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:00.542168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe32750-366c-4835-b196-3327030b789b None admin] RBAC: Authorizing `identity:get_user(user_id=b60f25f66e094231aaf30eb37a86f456)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:00.544274 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe32750-366c-4835-b196-3327030b789b None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:00.545840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 589/1151] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:28:00 2022] GET /identity/v3/users/b60f25f66e094231aaf30eb37a86f456 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:00.551529 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e30b93-dcd8-4876-ae51-f8bd592f73a5 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:00.640381 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:00.648812 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e30b93-dcd8-4876-ae51-f8bd592f73a5 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:00.681727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952d4a6-b079-45e5-8323-7709b2e4c2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:00.682600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952d4a6-b079-45e5-8323-7709b2e4c2e9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:00.682934 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952d4a6-b079-45e5-8323-7709b2e4c2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:00.683375 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952d4a6-b079-45e5-8323-7709b2e4c2e9 None admin] PATH_INFO: `/v3/projects/9d9eebe229c84a6780e357a0298a648d` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:00.685101 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952d4a6-b079-45e5-8323-7709b2e4c2e9 None admin] RBAC: Authorizing `identity:get_project(project_id=9d9eebe229c84a6780e357a0298a648d)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:00.686544 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952d4a6-b079-45e5-8323-7709b2e4c2e9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:00.688151 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 563/1152] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:00 2022] GET /identity/v3/projects/9d9eebe229c84a6780e357a0298a648d => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:00.694109 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe32750-366c-4835-b196-3327030b789b None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:00.707166 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:00.794662 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe32750-366c-4835-b196-3327030b789b None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:00.826915 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b607b8a-32c2-4a92-8fdf-95dd407aff95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:00.827560 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b607b8a-32c2-4a92-8fdf-95dd407aff95 None admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:00.827839 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b607b8a-32c2-4a92-8fdf-95dd407aff95 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:00.828112 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b607b8a-32c2-4a92-8fdf-95dd407aff95 None admin] PATH_INFO: `/v3/projects/9d9eebe229c84a6780e357a0298a648d/users/b60f25f66e094231aaf30eb37a86f456/roles/e3faa0474c054da6bb4d8910a4e40bff` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:00.830018 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b607b8a-32c2-4a92-8fdf-95dd407aff95 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d9eebe229c84a6780e357a0298a648d, user_id=b60f25f66e094231aaf30eb37a86f456, role_id=e3faa0474c054da6bb4d8910a4e40bff)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:00.831431 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b607b8a-32c2-4a92-8fdf-95dd407aff95 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:00.911058 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 590/1153] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 22 20:28:00 2022] PUT /identity/v3/projects/9d9eebe229c84a6780e357a0298a648d/users/b60f25f66e094231aaf30eb37a86f456/roles/e3faa0474c054da6bb4d8910a4e40bff => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:28:02.826386 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6f804-5a94-41e5-826a-0522e12bee3d None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:02.826857 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6f804-5a94-41e5-826a-0522e12bee3d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:02.826951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6f804-5a94-41e5-826a-0522e12bee3d None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:02.828246 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 564/1154] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:28:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:02.833438 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d42cc6-baf3-42c7-8034-8b05ac84514d None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:02.833853 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d42cc6-baf3-42c7-8034-8b05ac84514d None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:02.833988 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d42cc6-baf3-42c7-8034-8b05ac84514d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:02.852132 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-d7d42cc6-baf3-42c7-8034-8b05ac84514d None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:02.853351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-d7d42cc6-baf3-42c7-8034-8b05ac84514d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:02.914767 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:02.919750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 591/1155] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:28:03.188932 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6f804-5a94-41e5-826a-0522e12bee3d None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:03.289165 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6f804-5a94-41e5-826a-0522e12bee3d None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:03.322474 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dcd4e-c4ec-497a-8bb0-4b355c285755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:03.323087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dcd4e-c4ec-497a-8bb0-4b355c285755 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:03.323364 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dcd4e-c4ec-497a-8bb0-4b355c285755 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:03.323634 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dcd4e-c4ec-497a-8bb0-4b355c285755 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:03.334458 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212dcd4e-c4ec-497a-8bb0-4b355c285755 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:03.339021 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-212dcd4e-c4ec-497a-8bb0-4b355c285755 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:28:03.339021 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:03.339021 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:03.339021 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:03.339021 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:03.339021 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:03.339021 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:03.339021 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:03.339021 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:03.339021 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:03.339021 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:03.339021 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:03.339021 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:03.339021 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:03.339021 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:03.339021 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:03.340887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:03.340887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:03.340887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:03.340887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:03.340887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:03.340887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:03.340887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:03.340887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:03.340887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:03.340887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:03.340887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:03.340887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:03.340887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:03.340887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:03.340887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:03.340887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:03.341954 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:03.341954 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:03.341954 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:03.341954 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:03.341954 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:03.341954 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:03.341954 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:03.341954 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:03.341954 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:03.341954 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:03.341954 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:28:03.341954 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:28:03.345420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 565/1156] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 22 20:28:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:03.346698 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d42cc6-baf3-42c7-8034-8b05ac84514d None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:03.442134 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d42cc6-baf3-42c7-8034-8b05ac84514d None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:03.476142 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0b1d7-67ab-4efb-8882-c08ee8a29aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:03.476763 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0b1d7-67ab-4efb-8882-c08ee8a29aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:03.477043 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0b1d7-67ab-4efb-8882-c08ee8a29aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:03.477317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0b1d7-67ab-4efb-8882-c08ee8a29aa7 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:03.477968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f0b1d7-67ab-4efb-8882-c08ee8a29aa7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:03.478268 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f0b1d7-67ab-4efb-8882-c08ee8a29aa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:03.479642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f0b1d7-67ab-4efb-8882-c08ee8a29aa7 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:03.487613 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 592/1157] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:28:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:03.493443 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dcd4e-c4ec-497a-8bb0-4b355c285755 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:03.520324 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:03.594877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dcd4e-c4ec-497a-8bb0-4b355c285755 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:03.627172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafcc93-0c70-462b-b898-ed22ba1e30db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:03.627782 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafcc93-0c70-462b-b898-ed22ba1e30db None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:03.628059 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafcc93-0c70-462b-b898-ed22ba1e30db None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:03.628327 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafcc93-0c70-462b-b898-ed22ba1e30db None admin] PATH_INFO: `/v3/users/b60f25f66e094231aaf30eb37a86f456` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:03.629451 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbafcc93-0c70-462b-b898-ed22ba1e30db None admin] RBAC: Authorizing `identity:get_user(user_id=b60f25f66e094231aaf30eb37a86f456)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:03.630930 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbafcc93-0c70-462b-b898-ed22ba1e30db None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:03.632454 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 566/1158] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:28:03 2022] GET /identity/v3/users/b60f25f66e094231aaf30eb37a86f456 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:03.639074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0b1d7-67ab-4efb-8882-c08ee8a29aa7 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:03.698498 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:03.736832 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0b1d7-67ab-4efb-8882-c08ee8a29aa7 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:03.769261 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227d1c9-1540-41a3-8a21-3478115675b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:03.769851 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227d1c9-1540-41a3-8a21-3478115675b5 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:03.770125 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227d1c9-1540-41a3-8a21-3478115675b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:03.770393 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227d1c9-1540-41a3-8a21-3478115675b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:03.838265 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a227d1c9-1540-41a3-8a21-3478115675b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:03.840518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a227d1c9-1540-41a3-8a21-3478115675b5 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:03.896529 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:03.935867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 593/1159] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:28:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 20:28:03.941802 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafcc93-0c70-462b-b898-ed22ba1e30db None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:04.030809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:04.042093 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafcc93-0c70-462b-b898-ed22ba1e30db None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:04.075796 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db97ddc-348b-4bbb-9b09-e26bfeac3b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:04.076403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db97ddc-348b-4bbb-9b09-e26bfeac3b04 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:04.076697 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db97ddc-348b-4bbb-9b09-e26bfeac3b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:04.076970 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db97ddc-348b-4bbb-9b09-e26bfeac3b04 None admin] PATH_INFO: `/v3/projects/9d9eebe229c84a6780e357a0298a648d` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:04.078062 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db97ddc-348b-4bbb-9b09-e26bfeac3b04 None admin] RBAC: Authorizing `identity:get_project(project_id=9d9eebe229c84a6780e357a0298a648d)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:04.079484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db97ddc-348b-4bbb-9b09-e26bfeac3b04 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:04.081097 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 567/1160] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:03 2022] GET /identity/v3/projects/9d9eebe229c84a6780e357a0298a648d => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:04.087160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227d1c9-1540-41a3-8a21-3478115675b5 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:04.183634 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227d1c9-1540-41a3-8a21-3478115675b5 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:04.217173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9998557-413f-49ba-894e-b834af75814d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:04.217761 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9998557-413f-49ba-894e-b834af75814d None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:04.218042 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9998557-413f-49ba-894e-b834af75814d None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:04.218317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9998557-413f-49ba-894e-b834af75814d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:04.219030 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9998557-413f-49ba-894e-b834af75814d None admin] RBAC: Adding query filter params (role.id=e3faa0474c054da6bb4d8910a4e40bff, scope.project.id=9d9eebe229c84a6780e357a0298a648d, user.id=b60f25f66e094231aaf30eb37a86f456) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:04.219335 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9998557-413f-49ba-894e-b834af75814d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:04.220778 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9998557-413f-49ba-894e-b834af75814d None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:04.226305 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 594/1161] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:28:04 2022] GET /identity/v3/role_assignments?user.id=b60f25f66e094231aaf30eb37a86f456&scope.project.id=9d9eebe229c84a6780e357a0298a648d&role.id=e3faa0474c054da6bb4d8910a4e40bff => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:28:06.156487 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc18622-e258-4282-af9d-36812bf08078 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:06.157036 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc18622-e258-4282-af9d-36812bf08078 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:06.157151 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc18622-e258-4282-af9d-36812bf08078 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:06.158410 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 568/1162] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:06.163602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19dfe7-2ee4-41b8-bf65-8e478cff6bd6 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:06.163997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19dfe7-2ee4-41b8-bf65-8e478cff6bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:06.164141 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19dfe7-2ee4-41b8-bf65-8e478cff6bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:06.181908 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-4a19dfe7-2ee4-41b8-bf65-8e478cff6bd6 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:06.183113 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-4a19dfe7-2ee4-41b8-bf65-8e478cff6bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:06.204048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:06.248538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 595/1163] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:28:06.517662 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc18622-e258-4282-af9d-36812bf08078 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:06.616356 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc18622-e258-4282-af9d-36812bf08078 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:06.650045 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372d476-d0d9-4528-b3bf-240542b52eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:06.650642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372d476-d0d9-4528-b3bf-240542b52eba None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:06.650917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372d476-d0d9-4528-b3bf-240542b52eba None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:06.651186 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372d476-d0d9-4528-b3bf-240542b52eba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:06.675028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:06.717656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372d476-d0d9-4528-b3bf-240542b52eba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:06.719134 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372d476-d0d9-4528-b3bf-240542b52eba None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:06.816050 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 569/1164] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:28:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 20:28:06.822154 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19dfe7-2ee4-41b8-bf65-8e478cff6bd6 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:06.925756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19dfe7-2ee4-41b8-bf65-8e478cff6bd6 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:06.959101 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df839ec2-7b3e-47bd-9aa8-5e0daa378d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:06.959710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df839ec2-7b3e-47bd-9aa8-5e0daa378d61 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:06.959983 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df839ec2-7b3e-47bd-9aa8-5e0daa378d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:06.960249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df839ec2-7b3e-47bd-9aa8-5e0daa378d61 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:06.966716 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df839ec2-7b3e-47bd-9aa8-5e0daa378d61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:06.968147 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df839ec2-7b3e-47bd-9aa8-5e0daa378d61 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:06.978840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-df839ec2-7b3e-47bd-9aa8-5e0daa378d61 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 22 20:28:06.978840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:06.978840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 22 20:28:06.978840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 22 20:28:06.978840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:28:06.978840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:28:06.978840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:28:06.978840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:28:06.978840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 22 20:28:06.978840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:28:06.978840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:28:06.978840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:28:06.978840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:06.978840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:06.978840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:06.978840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:06.978840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:06.980538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:06.980538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:06.980538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:06.980538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:06.980538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:06.980538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:06.980538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:28:06.980538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:28:06.980538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:28:06.980538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:28:06.980538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:06.980538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:06.980538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:06.980538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:06.980538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:06.980538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:06.981439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:06.981439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:06.981439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:06.981439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:06.981439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:06.981439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:06.981439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:06.981439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:06.981439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:06.981439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:06.981439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 22 20:28:06.981439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:28:06.981439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 22 20:28:06.981439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:28:06.981439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 596/1165] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Aug 22 20:28:06 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:06.986525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372d476-d0d9-4528-b3bf-240542b52eba None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:07.040403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:07.083768 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372d476-d0d9-4528-b3bf-240542b52eba None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:07.116605 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793e16a-4b4f-4737-806a-be9d72494410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:07.117354 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793e16a-4b4f-4737-806a-be9d72494410 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:07.117630 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793e16a-4b4f-4737-806a-be9d72494410 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:07.117898 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793e16a-4b4f-4737-806a-be9d72494410 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:07.118525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3793e16a-4b4f-4737-806a-be9d72494410 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:07.118821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3793e16a-4b4f-4737-806a-be9d72494410 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:07.120177 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3793e16a-4b4f-4737-806a-be9d72494410 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:07.127675 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 570/1166] 10.222.0.62 () {56 vars in 1115 bytes} [Mon Aug 22 20:28:06 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:08.995387 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ab6eb-aa7f-4b82-ac37-4f4e41360127 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:08.995909 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ab6eb-aa7f-4b82-ac37-4f4e41360127 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:08.995909 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ab6eb-aa7f-4b82-ac37-4f4e41360127 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:08.997279 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 597/1167] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:09.003161 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14408258-a791-4564-b7be-1d56babedcd8 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:09.003562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14408258-a791-4564-b7be-1d56babedcd8 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:09.003702 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14408258-a791-4564-b7be-1d56babedcd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:09.022413 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-14408258-a791-4564-b7be-1d56babedcd8 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:09.023595 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-14408258-a791-4564-b7be-1d56babedcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:09.089486 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 571/1168] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:28:09.362805 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ab6eb-aa7f-4b82-ac37-4f4e41360127 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:09.381560 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:09.463570 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ab6eb-aa7f-4b82-ac37-4f4e41360127 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:09.497024 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec72c8-5395-43b8-8baf-678e33904a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:09.497610 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec72c8-5395-43b8-8baf-678e33904a05 None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:09.497884 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec72c8-5395-43b8-8baf-678e33904a05 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:09.498148 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec72c8-5395-43b8-8baf-678e33904a05 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:09.498792 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec72c8-5395-43b8-8baf-678e33904a05 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:09.500128 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec72c8-5395-43b8-8baf-678e33904a05 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:09.571408 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 598/1169] 10.222.0.62 () {60 vars in 1138 bytes} [Mon Aug 22 20:28:09 2022] POST /identity/v3/domains => generated 267 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:28:11.453811 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207808be-cc3b-4582-a58b-13af87beec79 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:11.454372 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207808be-cc3b-4582-a58b-13af87beec79 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:11.454372 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207808be-cc3b-4582-a58b-13af87beec79 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:11.455664 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 572/1170] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:11.461052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e236a68-6770-4ea6-9d45-6b04c8de9661 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:11.461431 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e236a68-6770-4ea6-9d45-6b04c8de9661 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:11.461591 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e236a68-6770-4ea6-9d45-6b04c8de9661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:11.480002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-9e236a68-6770-4ea6-9d45-6b04c8de9661 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:11.481830 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-9e236a68-6770-4ea6-9d45-6b04c8de9661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:11.545772 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 599/1171] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:28:11.820084 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207808be-cc3b-4582-a58b-13af87beec79 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:11.871727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:11.922052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207808be-cc3b-4582-a58b-13af87beec79 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:11.955676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4bdd1a-184d-479d-b9e2-692b01ef2389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:11.956291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4bdd1a-184d-479d-b9e2-692b01ef2389 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:11.956569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4bdd1a-184d-479d-b9e2-692b01ef2389 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:11.956864 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4bdd1a-184d-479d-b9e2-692b01ef2389 None admin] PATH_INFO: `/v3/domains/3c4c3ad1895845dfbb79e5517a850dee` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:11.967694 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4bdd1a-184d-479d-b9e2-692b01ef2389 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3c4c3ad1895845dfbb79e5517a850dee)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:11.969177 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4bdd1a-184d-479d-b9e2-692b01ef2389 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:11.970730 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 573/1172] 10.222.0.62 () {56 vars in 1183 bytes} [Mon Aug 22 20:28:11 2022] GET /identity/v3/domains/3c4c3ad1895845dfbb79e5517a850dee => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:11.976522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e236a68-6770-4ea6-9d45-6b04c8de9661 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:11.985278 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:12.074547 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e236a68-6770-4ea6-9d45-6b04c8de9661 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:12.107584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a3865-0f83-4bbe-97c6-38977f8c755f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:12.108174 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a3865-0f83-4bbe-97c6-38977f8c755f None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:12.108454 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a3865-0f83-4bbe-97c6-38977f8c755f None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:12.108758 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a3865-0f83-4bbe-97c6-38977f8c755f None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:12.109399 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a3865-0f83-4bbe-97c6-38977f8c755f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:12.110814 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a3865-0f83-4bbe-97c6-38977f8c755f None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:12.231789 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 600/1173] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Aug 22 20:28:11 2022] POST /identity/v3/projects => generated 361 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:28:14.140271 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94838b84-0d4f-49ec-b23f-0fa663f71e5c None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:14.140803 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94838b84-0d4f-49ec-b23f-0fa663f71e5c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:14.140896 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94838b84-0d4f-49ec-b23f-0fa663f71e5c None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:14.142165 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 574/1174] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:14.147317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf007c7-850d-4571-8aec-33326841ab8a None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:14.147703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf007c7-850d-4571-8aec-33326841ab8a None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:14.147873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf007c7-850d-4571-8aec-33326841ab8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:14.166104 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-eaf007c7-850d-4571-8aec-33326841ab8a None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:14.167912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-eaf007c7-850d-4571-8aec-33326841ab8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:14.218946 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:14.232510 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 601/1175] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:28:14.502682 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94838b84-0d4f-49ec-b23f-0fa663f71e5c None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:14.614069 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94838b84-0d4f-49ec-b23f-0fa663f71e5c None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:14.625213 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:14.652637 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f834e-5b8f-4a07-a36a-ab94680f77d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:14.653687 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f834e-5b8f-4a07-a36a-ab94680f77d3 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:14.654147 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f834e-5b8f-4a07-a36a-ab94680f77d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:14.654598 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f834e-5b8f-4a07-a36a-ab94680f77d3 None admin] PATH_INFO: `/v3/domains/3c4c3ad1895845dfbb79e5517a850dee` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:14.656351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f834e-5b8f-4a07-a36a-ab94680f77d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3c4c3ad1895845dfbb79e5517a850dee)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:14.657944 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f834e-5b8f-4a07-a36a-ab94680f77d3 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:14.659573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 575/1176] 10.222.0.62 () {56 vars in 1183 bytes} [Mon Aug 22 20:28:14 2022] GET /identity/v3/domains/3c4c3ad1895845dfbb79e5517a850dee => generated 267 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:14.665591 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf007c7-850d-4571-8aec-33326841ab8a None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:14.772254 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf007c7-850d-4571-8aec-33326841ab8a None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:14.810728 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f241688-c8f2-48d8-89b4-d813c2f7bb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:14.811379 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f241688-c8f2-48d8-89b4-d813c2f7bb55 None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:14.811658 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f241688-c8f2-48d8-89b4-d813c2f7bb55 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:14.811935 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f241688-c8f2-48d8-89b4-d813c2f7bb55 None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:14.812577 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f241688-c8f2-48d8-89b4-d813c2f7bb55 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:14.814056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f241688-c8f2-48d8-89b4-d813c2f7bb55 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:14.882280 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 602/1177] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Aug 22 20:28:14 2022] POST /identity/v3/users => generated 311 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:28:16.826197 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c0de9-b6c9-499b-bade-61ae544e85a3 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:16.826747 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c0de9-b6c9-499b-bade-61ae544e85a3 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:16.826747 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c0de9-b6c9-499b-bade-61ae544e85a3 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:16.828048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 576/1178] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:16.833166 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b651c-b0f3-49a2-9744-34345c38f850 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:16.833612 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b651c-b0f3-49a2-9744-34345c38f850 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:16.833711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b651c-b0f3-49a2-9744-34345c38f850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:16.851563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-ce1b651c-b0f3-49a2-9744-34345c38f850 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:16.852758 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-ce1b651c-b0f3-49a2-9744-34345c38f850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:16.892118 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:16.917828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 603/1179] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:28:17.188454 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c0de9-b6c9-499b-bade-61ae544e85a3 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:17.287175 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c0de9-b6c9-499b-bade-61ae544e85a3 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:17.319550 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89409f-9fba-4f41-b77c-891635868f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:17.320157 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89409f-9fba-4f41-b77c-891635868f84 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:17.320430 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89409f-9fba-4f41-b77c-891635868f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:17.320718 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89409f-9fba-4f41-b77c-891635868f84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:17.330800 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89409f-9fba-4f41-b77c-891635868f84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:17.335493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-ce89409f-9fba-4f41-b77c-891635868f84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:28:17.335493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:17.335493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:17.335493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:17.335493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:17.335493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:17.335493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:17.335493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:17.335493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:17.335493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:17.335493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:17.335493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:17.335493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:17.335493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:17.335493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:17.335493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:17.336676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:17.336676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:17.336676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:17.336676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:17.336676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:17.336676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:17.336676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:17.336676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:17.336676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:17.336676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:17.336676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:17.336676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:17.336676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:17.336676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:17.336676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:17.336676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:17.337598 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:17.337598 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:17.337598 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:17.337598 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:17.337598 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:17.337598 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:17.337598 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:17.337598 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:17.337598 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:17.337598 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:17.337598 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:28:17.337598 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:28:17.337598 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 577/1180] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 22 20:28:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:17.343332 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b651c-b0f3-49a2-9744-34345c38f850 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:17.440441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b651c-b0f3-49a2-9744-34345c38f850 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:17.474195 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621515b2-b77a-4a66-a8b0-3948bc07741f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:17.474793 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621515b2-b77a-4a66-a8b0-3948bc07741f None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:17.475071 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621515b2-b77a-4a66-a8b0-3948bc07741f None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:17.475342 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621515b2-b77a-4a66-a8b0-3948bc07741f None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:17.476075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621515b2-b77a-4a66-a8b0-3948bc07741f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:17.476375 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621515b2-b77a-4a66-a8b0-3948bc07741f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:17.477792 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621515b2-b77a-4a66-a8b0-3948bc07741f None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:17.485650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 604/1181] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:28:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:17.491343 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89409f-9fba-4f41-b77c-891635868f84 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:17.531510 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:17.591152 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89409f-9fba-4f41-b77c-891635868f84 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:17.624124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928348a-6feb-48df-885e-4a45adb85709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:17.624772 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928348a-6feb-48df-885e-4a45adb85709 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:17.625055 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928348a-6feb-48df-885e-4a45adb85709 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:17.625327 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928348a-6feb-48df-885e-4a45adb85709 None admin] PATH_INFO: `/v3/users/59ae854de2124d1d87708ba3d29a1e0d` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:17.696490 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928348a-6feb-48df-885e-4a45adb85709 None admin] RBAC: Authorizing `identity:get_user(user_id=59ae854de2124d1d87708ba3d29a1e0d)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:17.698537 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928348a-6feb-48df-885e-4a45adb85709 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:17.700508 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 578/1182] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:28:17 2022] GET /identity/v3/users/59ae854de2124d1d87708ba3d29a1e0d => generated 311 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:17.706466 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621515b2-b77a-4a66-a8b0-3948bc07741f None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:17.740750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:17.803338 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621515b2-b77a-4a66-a8b0-3948bc07741f None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:17.838589 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29df035-2bdf-4e47-beb5-5ed2ce687d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:17.839232 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29df035-2bdf-4e47-beb5-5ed2ce687d16 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:17.839489 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29df035-2bdf-4e47-beb5-5ed2ce687d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:17.839763 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29df035-2bdf-4e47-beb5-5ed2ce687d16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:17.906761 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29df035-2bdf-4e47-beb5-5ed2ce687d16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:17.908222 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29df035-2bdf-4e47-beb5-5ed2ce687d16 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:17.940441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:18.003654 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 605/1183] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:28:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 20:28:18.009629 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928348a-6feb-48df-885e-4a45adb85709 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:18.101296 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:18.107546 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928348a-6feb-48df-885e-4a45adb85709 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:18.140907 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33519b5-34b9-47ea-b682-f5395f19c2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:18.141528 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33519b5-34b9-47ea-b682-f5395f19c2ce None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:18.141805 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33519b5-34b9-47ea-b682-f5395f19c2ce None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:18.142076 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33519b5-34b9-47ea-b682-f5395f19c2ce None admin] PATH_INFO: `/v3/projects/680c43235505474093f665280d01492d` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:18.143176 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33519b5-34b9-47ea-b682-f5395f19c2ce None admin] RBAC: Authorizing `identity:get_project(project_id=680c43235505474093f665280d01492d)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:18.144609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33519b5-34b9-47ea-b682-f5395f19c2ce None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:18.146232 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 579/1184] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:18 2022] GET /identity/v3/projects/680c43235505474093f665280d01492d => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:18.152417 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29df035-2bdf-4e47-beb5-5ed2ce687d16 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:18.248534 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29df035-2bdf-4e47-beb5-5ed2ce687d16 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:18.280827 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efcb50-dfd2-4740-834e-348108d85d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:18.281352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efcb50-dfd2-4740-834e-348108d85d69 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:18.281683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efcb50-dfd2-4740-834e-348108d85d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:18.281952 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efcb50-dfd2-4740-834e-348108d85d69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:18.282660 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efcb50-dfd2-4740-834e-348108d85d69 None admin] RBAC: Adding query filter params (role.id=e3faa0474c054da6bb4d8910a4e40bff, scope.project.id=680c43235505474093f665280d01492d, user.id=59ae854de2124d1d87708ba3d29a1e0d) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:18.282963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efcb50-dfd2-4740-834e-348108d85d69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:18.284367 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efcb50-dfd2-4740-834e-348108d85d69 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:18.287089 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:18.289783 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 606/1185] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:28:18 2022] GET /identity/v3/role_assignments?user.id=59ae854de2124d1d87708ba3d29a1e0d&scope.project.id=680c43235505474093f665280d01492d&role.id=e3faa0474c054da6bb4d8910a4e40bff => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:20.159792 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23138be2-8ba5-4fc8-b98c-c6eff1cb6ef3 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:20.160337 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23138be2-8ba5-4fc8-b98c-c6eff1cb6ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:20.160337 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23138be2-8ba5-4fc8-b98c-c6eff1cb6ef3 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:20.161695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 580/1186] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:20.167392 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b309d7b-ab31-4aa7-bb94-c4aad3ff6dcb None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:20.167771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b309d7b-ab31-4aa7-bb94-c4aad3ff6dcb None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:20.167930 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b309d7b-ab31-4aa7-bb94-c4aad3ff6dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:20.185889 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-0b309d7b-ab31-4aa7-bb94-c4aad3ff6dcb None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:20.187057 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-0b309d7b-ab31-4aa7-bb94-c4aad3ff6dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:20.255677 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 607/1187] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:28:20.534744 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23138be2-8ba5-4fc8-b98c-c6eff1cb6ef3 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:20.637945 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23138be2-8ba5-4fc8-b98c-c6eff1cb6ef3 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:20.672372 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18be00-d3f1-4cd0-a915-8900416d42e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:20.673006 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18be00-d3f1-4cd0-a915-8900416d42e3 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:20.673281 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18be00-d3f1-4cd0-a915-8900416d42e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:20.673546 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18be00-d3f1-4cd0-a915-8900416d42e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:20.683775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18be00-d3f1-4cd0-a915-8900416d42e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:20.688333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-fb18be00-d3f1-4cd0-a915-8900416d42e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:28:20.688333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:20.688333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:20.688333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:20.688333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:20.688333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:20.688333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:20.688333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:20.688333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:20.688333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:20.688333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:20.688333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:20.688333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:20.688333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:20.688333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:20.688333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:20.689424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:20.689424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:20.689424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:20.689424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:20.689424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:20.689424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:20.689424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:20.689424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:20.689424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:20.689424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:20.689424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:20.689424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:20.689424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:20.689424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:20.689424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:20.689424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:20.690265 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:20.690265 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:20.690265 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:20.690265 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:20.690265 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:20.690265 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:20.690265 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:20.690265 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:20.690265 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:20.690265 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:20.690265 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:28:20.690265 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:28:20.690265 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 581/1188] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 22 20:28:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:20.695843 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b309d7b-ab31-4aa7-bb94-c4aad3ff6dcb None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:20.792137 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b309d7b-ab31-4aa7-bb94-c4aad3ff6dcb None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:20.821670 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:20.828120 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45249a74-2520-4cb7-898b-040496727f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:20.828756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45249a74-2520-4cb7-898b-040496727f6f None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:20.829086 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45249a74-2520-4cb7-898b-040496727f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:20.829360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45249a74-2520-4cb7-898b-040496727f6f None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:20.830015 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45249a74-2520-4cb7-898b-040496727f6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:20.830314 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45249a74-2520-4cb7-898b-040496727f6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:20.831678 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45249a74-2520-4cb7-898b-040496727f6f None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:20.839822 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 608/1189] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:28:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:20.845899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18be00-d3f1-4cd0-a915-8900416d42e3 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:20.872153 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:20.947016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18be00-d3f1-4cd0-a915-8900416d42e3 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:20.981449 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b674fba-9bf0-472d-8bfb-0dddb36d305e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:20.982067 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b674fba-9bf0-472d-8bfb-0dddb36d305e None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:20.982346 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b674fba-9bf0-472d-8bfb-0dddb36d305e None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:20.982622 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b674fba-9bf0-472d-8bfb-0dddb36d305e None admin] PATH_INFO: `/v3/users/59ae854de2124d1d87708ba3d29a1e0d` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:20.983816 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b674fba-9bf0-472d-8bfb-0dddb36d305e None admin] RBAC: Authorizing `identity:get_user(user_id=59ae854de2124d1d87708ba3d29a1e0d)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:20.985291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b674fba-9bf0-472d-8bfb-0dddb36d305e None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:20.986847 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 582/1190] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:28:20 2022] GET /identity/v3/users/59ae854de2124d1d87708ba3d29a1e0d => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:20.992676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45249a74-2520-4cb7-898b-040496727f6f None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:21.093752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45249a74-2520-4cb7-898b-040496727f6f None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:21.126245 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e13871-5b5a-451a-80c4-77d082e367af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:21.126858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e13871-5b5a-451a-80c4-77d082e367af None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:21.127131 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e13871-5b5a-451a-80c4-77d082e367af None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:21.127399 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e13871-5b5a-451a-80c4-77d082e367af None admin] PATH_INFO: `/v3/projects/680c43235505474093f665280d01492d` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:21.128477 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e13871-5b5a-451a-80c4-77d082e367af None admin] RBAC: Authorizing `identity:get_project(project_id=680c43235505474093f665280d01492d)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:21.129931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e13871-5b5a-451a-80c4-77d082e367af None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:21.131515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 609/1191] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:20 2022] GET /identity/v3/projects/680c43235505474093f665280d01492d => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:21.137889 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b674fba-9bf0-472d-8bfb-0dddb36d305e None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:21.226001 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:21.234977 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b674fba-9bf0-472d-8bfb-0dddb36d305e None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:21.269032 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132de23-5172-4b5b-b928-c55ebf66ce28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:21.269667 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132de23-5172-4b5b-b928-c55ebf66ce28 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:21.269943 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132de23-5172-4b5b-b928-c55ebf66ce28 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:21.270213 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132de23-5172-4b5b-b928-c55ebf66ce28 None admin] PATH_INFO: `/v3/projects/680c43235505474093f665280d01492d/users/59ae854de2124d1d87708ba3d29a1e0d/roles/e3faa0474c054da6bb4d8910a4e40bff` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:21.272075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132de23-5172-4b5b-b928-c55ebf66ce28 None admin] RBAC: Authorizing `identity:create_grant(project_id=680c43235505474093f665280d01492d, user_id=59ae854de2124d1d87708ba3d29a1e0d, role_id=e3faa0474c054da6bb4d8910a4e40bff)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:21.273530 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132de23-5172-4b5b-b928-c55ebf66ce28 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:21.337679 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 583/1192] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 22 20:28:21 2022] PUT /identity/v3/projects/680c43235505474093f665280d01492d/users/59ae854de2124d1d87708ba3d29a1e0d/roles/e3faa0474c054da6bb4d8910a4e40bff => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:28:23.229011 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79327d4e-baaf-4ab0-aa9a-10ed800e553d None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:23.229569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79327d4e-baaf-4ab0-aa9a-10ed800e553d None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:23.229569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79327d4e-baaf-4ab0-aa9a-10ed800e553d None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:23.230863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 610/1193] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:28:23.236242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e460ea-fcda-49fc-9140-18ca0c3099a2 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:23.236685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e460ea-fcda-49fc-9140-18ca0c3099a2 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:23.236833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e460ea-fcda-49fc-9140-18ca0c3099a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:23.255020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-b2e460ea-fcda-49fc-9140-18ca0c3099a2 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:28:23.256210 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b2e460ea-fcda-49fc-9140-18ca0c3099a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:28:23.321419 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 584/1194] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:28:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:28:23.597567 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79327d4e-baaf-4ab0-aa9a-10ed800e553d None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:23.657912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:23.699829 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79327d4e-baaf-4ab0-aa9a-10ed800e553d None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:23.732224 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16c469-c6a7-40fe-9975-78820cb9f101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:23.732866 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16c469-c6a7-40fe-9975-78820cb9f101 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:23.733141 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16c469-c6a7-40fe-9975-78820cb9f101 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:23.733406 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16c469-c6a7-40fe-9975-78820cb9f101 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:23.742944 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16c469-c6a7-40fe-9975-78820cb9f101 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:28:23.748098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-2a16c469-c6a7-40fe-9975-78820cb9f101 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:28:23.748098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:28:23.748098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:28:23.748098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:28:23.748098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:28:23.748098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:28:23.748098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:28:23.748098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:28:23.748098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:28:23.748098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:28:23.748098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:28:23.748098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:28:23.748098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:28:23.748098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:28:23.748098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:28:23.748098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:28:23.749249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:28:23.749249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:28:23.749249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:28:23.749249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:28:23.749249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:28:23.749249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:28:23.749249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:28:23.749249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:28:23.749249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:28:23.749249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:28:23.749249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:28:23.749249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:28:23.749249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:28:23.749249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:28:23.749249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:28:23.749249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:28:23.750268 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:28:23.750268 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:28:23.750268 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:28:23.750268 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:28:23.750268 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:28:23.750268 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:28:23.750268 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:28:23.750268 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:28:23.750268 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:28:23.750268 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:28:23.750268 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:28:23.750268 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:28:23.750268 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 611/1195] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 22 20:28:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:28:23.755227 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e460ea-fcda-49fc-9140-18ca0c3099a2 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:23.836943 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:23.854703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e460ea-fcda-49fc-9140-18ca0c3099a2 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:23.888932 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d2cf9-6243-4497-9c93-b736d583afae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:23.889530 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d2cf9-6243-4497-9c93-b736d583afae None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:23.889812 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d2cf9-6243-4497-9c93-b736d583afae None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:23.890084 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d2cf9-6243-4497-9c93-b736d583afae None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:23.890800 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d2cf9-6243-4497-9c93-b736d583afae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:23.891115 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d2cf9-6243-4497-9c93-b736d583afae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:23.892902 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d2cf9-6243-4497-9c93-b736d583afae None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:23.901307 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 585/1196] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:28:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:23.907124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16c469-c6a7-40fe-9975-78820cb9f101 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:24.008391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16c469-c6a7-40fe-9975-78820cb9f101 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:24.028226 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:24.048505 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc41d4e-167d-4b89-ab7d-6087c14bdf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:24.049141 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc41d4e-167d-4b89-ab7d-6087c14bdf87 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:24.049417 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc41d4e-167d-4b89-ab7d-6087c14bdf87 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:24.049688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc41d4e-167d-4b89-ab7d-6087c14bdf87 None admin] PATH_INFO: `/v3/users/59ae854de2124d1d87708ba3d29a1e0d` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:24.050825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc41d4e-167d-4b89-ab7d-6087c14bdf87 None admin] RBAC: Authorizing `identity:get_user(user_id=59ae854de2124d1d87708ba3d29a1e0d)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:24.052240 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc41d4e-167d-4b89-ab7d-6087c14bdf87 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:24.053815 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 612/1197] 10.222.0.62 () {56 vars in 1177 bytes} [Mon Aug 22 20:28:23 2022] GET /identity/v3/users/59ae854de2124d1d87708ba3d29a1e0d => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:24.060226 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d2cf9-6243-4497-9c93-b736d583afae None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:24.158329 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d2cf9-6243-4497-9c93-b736d583afae None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:24.192338 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2fe63-5c2f-4beb-93d6-e58146dfa9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:24.192958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2fe63-5c2f-4beb-93d6-e58146dfa9f1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:24.193237 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2fe63-5c2f-4beb-93d6-e58146dfa9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:24.193770 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2fe63-5c2f-4beb-93d6-e58146dfa9f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:24.208128 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:24.260861 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2fe63-5c2f-4beb-93d6-e58146dfa9f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:24.262308 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c2fe63-5c2f-4beb-93d6-e58146dfa9f1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:24.359216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 586/1198] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:28:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 20:28:24.365112 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc41d4e-167d-4b89-ab7d-6087c14bdf87 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:24.461978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc41d4e-167d-4b89-ab7d-6087c14bdf87 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:24.494680 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d447fbe-9805-4a84-b5f3-5009a4d8b7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:24.495293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d447fbe-9805-4a84-b5f3-5009a4d8b7c4 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:24.495568 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d447fbe-9805-4a84-b5f3-5009a4d8b7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:24.495837 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d447fbe-9805-4a84-b5f3-5009a4d8b7c4 None admin] PATH_INFO: `/v3/projects/680c43235505474093f665280d01492d` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:24.496967 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d447fbe-9805-4a84-b5f3-5009a4d8b7c4 None admin] RBAC: Authorizing `identity:get_project(project_id=680c43235505474093f665280d01492d)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:24.498391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d447fbe-9805-4a84-b5f3-5009a4d8b7c4 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:24.499973 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 613/1199] 10.222.0.62 () {56 vars in 1186 bytes} [Mon Aug 22 20:28:24 2022] GET /identity/v3/projects/680c43235505474093f665280d01492d => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:24.506181 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2fe63-5c2f-4beb-93d6-e58146dfa9f1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:28:24.550350 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:24.602011 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2fe63-5c2f-4beb-93d6-e58146dfa9f1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:28:24.644101 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5aa01-77b6-45a5-8cc2-1591da9ec98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:28:24.644711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5aa01-77b6-45a5-8cc2-1591da9ec98b None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:28:24.644991 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5aa01-77b6-45a5-8cc2-1591da9ec98b None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:28:24.645258 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5aa01-77b6-45a5-8cc2-1591da9ec98b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:28:24.645968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5aa01-77b6-45a5-8cc2-1591da9ec98b None admin] RBAC: Adding query filter params (role.id=e3faa0474c054da6bb4d8910a4e40bff, scope.project.id=680c43235505474093f665280d01492d, user.id=59ae854de2124d1d87708ba3d29a1e0d) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:28:24.646270 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5aa01-77b6-45a5-8cc2-1591da9ec98b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:28:24.647686 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5aa01-77b6-45a5-8cc2-1591da9ec98b None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:28:24.653860 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 587/1200] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:28:24 2022] GET /identity/v3/role_assignments?user.id=59ae854de2124d1d87708ba3d29a1e0d&scope.project.id=680c43235505474093f665280d01492d&role.id=e3faa0474c054da6bb4d8910a4e40bff => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:28:34.490618 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=72 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:28:34.651274 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=46 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:38.656122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40e586-8a7f-4248-8ba3-05a4ce3700d7 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:38.656875 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40e586-8a7f-4248-8ba3-05a4ce3700d7 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:38.656875 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d40e586-8a7f-4248-8ba3-05a4ce3700d7 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:38.658000 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 614/1201] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:38.663413 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d363533-0965-4665-9b36-affae64602cc None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:38.663864 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d363533-0965-4665-9b36-affae64602cc None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:38.663964 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d363533-0965-4665-9b36-affae64602cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:38.683044 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-2d363533-0965-4665-9b36-affae64602cc None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:38.684366 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2d363533-0965-4665-9b36-affae64602cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:38.753053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 588/1202] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:29:39.029743 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40e586-8a7f-4248-8ba3-05a4ce3700d7 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:39.131773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d40e586-8a7f-4248-8ba3-05a4ce3700d7 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:39.166154 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a75ff-4461-45f4-a9d8-24619c39e38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:39.166792 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a75ff-4461-45f4-a9d8-24619c39e38c None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:39.167073 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a75ff-4461-45f4-a9d8-24619c39e38c None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:39.167346 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a75ff-4461-45f4-a9d8-24619c39e38c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:39.177288 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a75ff-4461-45f4-a9d8-24619c39e38c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:39.178734 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a75ff-4461-45f4-a9d8-24619c39e38c None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:39.193672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-141a75ff-4461-45f4-a9d8-24619c39e38c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:39.193672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:39.193672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:39.193672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:39.193672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:39.193672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:39.193672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:39.193672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:39.193672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:39.193672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:39.193672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:39.193672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:39.193672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:39.193672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:39.193672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:39.193672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:39.194868 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:39.194868 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:39.194868 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:39.194868 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:39.194868 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:39.194868 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:39.194868 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:39.194868 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:39.194868 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:39.194868 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:39.194868 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:39.194868 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:39.194868 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:39.194868 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:39.194868 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:39.194868 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:39.194868 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:39.195826 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:39.195826 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:39.195826 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:29:39.195826 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 615/1203] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:39.200879 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d363533-0965-4665-9b36-affae64602cc None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:39.304732 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d363533-0965-4665-9b36-affae64602cc None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:39.335217 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:39.340941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4502c-0e5f-49d0-8562-92afa4a25ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:39.341572 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4502c-0e5f-49d0-8562-92afa4a25ccf None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:39.342005 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4502c-0e5f-49d0-8562-92afa4a25ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:39.342276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4502c-0e5f-49d0-8562-92afa4a25ccf None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:39.342907 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca4502c-0e5f-49d0-8562-92afa4a25ccf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:39.343207 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca4502c-0e5f-49d0-8562-92afa4a25ccf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:39.344567 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca4502c-0e5f-49d0-8562-92afa4a25ccf None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:39.355652 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 589/1204] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:39.361960 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a75ff-4461-45f4-a9d8-24619c39e38c None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:39.414104 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:39.460823 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a75ff-4461-45f4-a9d8-24619c39e38c None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:39.492771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4baf4-87de-4f89-bff6-aa694d6b2ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:39.493360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4baf4-87de-4f89-bff6-aa694d6b2ac7 None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:39.493634 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4baf4-87de-4f89-bff6-aa694d6b2ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:39.493900 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4baf4-87de-4f89-bff6-aa694d6b2ac7 None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:39.494528 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4baf4-87de-4f89-bff6-aa694d6b2ac7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:39.495959 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4baf4-87de-4f89-bff6-aa694d6b2ac7 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:39.583012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 616/1205] 10.222.0.62 () {60 vars in 1132 bytes} [Mon Aug 22 20:29:39 2022] POST /identity/v3/users => generated 251 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:29:41.515850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d7ec1-9a4a-4ef1-b75e-252a9c313bdd None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:41.516411 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d7ec1-9a4a-4ef1-b75e-252a9c313bdd None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:41.516411 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d7ec1-9a4a-4ef1-b75e-252a9c313bdd None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:41.517771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 590/1206] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:41.522874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac1f64-2cbd-4ece-9626-88c9b70b6317 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:41.523297 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac1f64-2cbd-4ece-9626-88c9b70b6317 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:41.523457 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac1f64-2cbd-4ece-9626-88c9b70b6317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:41.541256 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-64ac1f64-2cbd-4ece-9626-88c9b70b6317 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:41.542448 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-64ac1f64-2cbd-4ece-9626-88c9b70b6317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:41.609814 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 617/1207] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:29:41.890917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d7ec1-9a4a-4ef1-b75e-252a9c313bdd None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:41.994438 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d7ec1-9a4a-4ef1-b75e-252a9c313bdd None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:42.028232 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36929a6c-e392-44f5-aee8-71ea0c35e620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:42.028992 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36929a6c-e392-44f5-aee8-71ea0c35e620 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:42.029428 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36929a6c-e392-44f5-aee8-71ea0c35e620 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:42.029844 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36929a6c-e392-44f5-aee8-71ea0c35e620 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:42.040360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36929a6c-e392-44f5-aee8-71ea0c35e620 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:29:42.045571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-36929a6c-e392-44f5-aee8-71ea0c35e620 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:29:42.045571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:42.045571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:42.045571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:42.045571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:42.045571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:42.045571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:42.045571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:42.045571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:42.045571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:42.045571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:42.045571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:42.045571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:29:42.045571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:29:42.045571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:29:42.045571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:29:42.046729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:29:42.046729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:29:42.046729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:29:42.046729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:29:42.046729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:42.046729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:42.046729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:42.046729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:42.046729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:42.046729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:42.046729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:42.046729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:42.046729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:42.046729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:42.046729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:42.046729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:42.047599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:42.047599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:42.047599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:42.047599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:42.047599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:29:42.047599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:29:42.047599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:29:42.047599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:29:42.047599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:29:42.047599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:29:42.047599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:29:42.047599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:29:42.047599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 591/1208] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 22 20:29:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:42.053666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac1f64-2cbd-4ece-9626-88c9b70b6317 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:42.093649 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:42.151993 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac1f64-2cbd-4ece-9626-88c9b70b6317 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:42.186119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5d387-bd42-4a3e-af4f-51876b89b501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:42.186717 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5d387-bd42-4a3e-af4f-51876b89b501 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:42.186996 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5d387-bd42-4a3e-af4f-51876b89b501 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:42.187268 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5d387-bd42-4a3e-af4f-51876b89b501 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:42.187953 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5d387-bd42-4a3e-af4f-51876b89b501 None admin] RBAC: Adding query filter params (name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:42.188249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5d387-bd42-4a3e-af4f-51876b89b501 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:42.189661 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5d387-bd42-4a3e-af4f-51876b89b501 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:42.198388 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 618/1209] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 22 20:29:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:29:42.204314 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36929a6c-e392-44f5-aee8-71ea0c35e620 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:42.255460 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:42.312933 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36929a6c-e392-44f5-aee8-71ea0c35e620 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:42.346104 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f5299-0be5-401a-a8b1-4f49727fb297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:42.346727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f5299-0be5-401a-a8b1-4f49727fb297 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:42.347002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f5299-0be5-401a-a8b1-4f49727fb297 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:42.347270 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f5299-0be5-401a-a8b1-4f49727fb297 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:42.358063 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f5299-0be5-401a-a8b1-4f49727fb297 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:42.359569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f5299-0be5-401a-a8b1-4f49727fb297 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:42.373391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-f23f5299-0be5-401a-a8b1-4f49727fb297 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:42.373391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:42.373391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:42.373391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:42.373391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:42.373391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:42.373391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:42.373391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:42.373391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:42.373391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:42.373391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:42.373391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:42.373391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:42.373391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:42.373391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:42.373391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:42.374503 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:42.374503 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:42.374503 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:42.374503 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:42.374503 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:42.374503 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:42.374503 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:42.374503 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:42.374503 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:42.374503 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:42.374503 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:42.374503 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:42.374503 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:42.374503 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:42.374503 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:42.374503 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:42.374503 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:42.375390 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:42.375390 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:42.375390 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:29:42.375390 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 592/1210] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:42.380470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5d387-bd42-4a3e-af4f-51876b89b501 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:42.475780 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:42.478607 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5d387-bd42-4a3e-af4f-51876b89b501 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:42.511592 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c4b13-bf66-45ea-8d4e-0991fddbe051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:42.512216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c4b13-bf66-45ea-8d4e-0991fddbe051 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:42.512493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c4b13-bf66-45ea-8d4e-0991fddbe051 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:42.512797 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c4b13-bf66-45ea-8d4e-0991fddbe051 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:42.513560 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c4b13-bf66-45ea-8d4e-0991fddbe051 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:42.516027 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c4b13-bf66-45ea-8d4e-0991fddbe051 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:42.516027 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c4b13-bf66-45ea-8d4e-0991fddbe051 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:42.526020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 619/1211] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:42.532453 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f5299-0be5-401a-a8b1-4f49727fb297 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:42.631551 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f5299-0be5-401a-a8b1-4f49727fb297 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:42.633035 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:42.665021 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b253c8-a11a-42bc-ba95-77d274dfd97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:42.665669 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b253c8-a11a-42bc-ba95-77d274dfd97f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:42.665998 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b253c8-a11a-42bc-ba95-77d274dfd97f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:42.666266 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b253c8-a11a-42bc-ba95-77d274dfd97f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:42.674000 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b253c8-a11a-42bc-ba95-77d274dfd97f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:42.675423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b253c8-a11a-42bc-ba95-77d274dfd97f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:42.686319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-28b253c8-a11a-42bc-ba95-77d274dfd97f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 20:29:42.686319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:42.686319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:42.686319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:42.686319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:42.686319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:42.686319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:42.686319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:42.686319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:42.686319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:42.686319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:42.686319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:42.686319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:29:42.686319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:29:42.686319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:29:42.686319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:29:42.695107 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:42.695107 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:42.695107 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:29:42.695107 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:42.695107 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:29:42.695107 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:42.695107 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:42.695107 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:42.695107 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:42.695107 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:42.695107 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:42.695107 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:42.695107 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:42.695107 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:42.695107 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:42.695107 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:42.695107 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:42.695107 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:42.696358 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:42.696358 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:42.696358 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:29:42.696358 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:29:42.696358 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:29:42.696358 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:29:42.696358 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:29:42.696358 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:29:42.696358 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 20:29:42.696358 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:29:42.696358 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 593/1212] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:29:42.697025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c4b13-bf66-45ea-8d4e-0991fddbe051 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:42.792784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c4b13-bf66-45ea-8d4e-0991fddbe051 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:42.826698 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34811d-40f4-4f47-a9d1-378626a16a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:42.827300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34811d-40f4-4f47-a9d1-378626a16a74 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:42.827582 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34811d-40f4-4f47-a9d1-378626a16a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:42.827863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34811d-40f4-4f47-a9d1-378626a16a74 None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:42.828582 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34811d-40f4-4f47-a9d1-378626a16a74 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:42.828916 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34811d-40f4-4f47-a9d1-378626a16a74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:42.830343 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34811d-40f4-4f47-a9d1-378626a16a74 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:42.847766 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 620/1213] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Aug 22 20:29:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:42.853708 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b253c8-a11a-42bc-ba95-77d274dfd97f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:42.956110 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b253c8-a11a-42bc-ba95-77d274dfd97f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:42.988719 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90330a-66c6-4b90-b354-cbd54da08b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:42.989319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90330a-66c6-4b90-b354-cbd54da08b1a None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:42.989597 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90330a-66c6-4b90-b354-cbd54da08b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:42.989864 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90330a-66c6-4b90-b354-cbd54da08b1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:43.019347 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:43.056206 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90330a-66c6-4b90-b354-cbd54da08b1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:43.057683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90330a-66c6-4b90-b354-cbd54da08b1a None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:43.157171 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 594/1214] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:29:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 20:29:43.163167 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34811d-40f4-4f47-a9d1-378626a16a74 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:43.186822 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:43.267470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34811d-40f4-4f47-a9d1-378626a16a74 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:43.302548 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b3087-aa75-4054-acc0-90b09323e739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:43.303158 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b3087-aa75-4054-acc0-90b09323e739 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:43.303436 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b3087-aa75-4054-acc0-90b09323e739 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:43.303708 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b3087-aa75-4054-acc0-90b09323e739 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:43.314284 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b3087-aa75-4054-acc0-90b09323e739 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:43.315711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b3087-aa75-4054-acc0-90b09323e739 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:43.331124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-4c8b3087-aa75-4054-acc0-90b09323e739 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:43.331124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:43.331124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:43.331124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:43.331124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:43.331124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:43.331124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:43.331124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:43.331124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:43.331124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:43.331124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:43.331124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:43.331124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:43.331124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:43.331124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:43.331124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:43.332221 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:43.332221 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:43.332221 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:43.332221 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:43.332221 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:43.332221 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:43.332221 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:43.332221 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:43.332221 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:43.332221 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:43.332221 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:43.332221 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:43.332221 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:43.332221 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:43.332221 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:43.332221 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:43.332221 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:43.333539 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:43.333539 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:43.333539 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:29:43.333539 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 621/1215] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:43.337965 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90330a-66c6-4b90-b354-cbd54da08b1a None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:43.399449 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:43.437048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90330a-66c6-4b90-b354-cbd54da08b1a None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:43.471335 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c79263-dfb0-4c88-93b2-b802509eb8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:43.471947 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c79263-dfb0-4c88-93b2-b802509eb8d1 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:43.472223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c79263-dfb0-4c88-93b2-b802509eb8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:43.472489 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c79263-dfb0-4c88-93b2-b802509eb8d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:43.473170 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c79263-dfb0-4c88-93b2-b802509eb8d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:43.479236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c79263-dfb0-4c88-93b2-b802509eb8d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:43.479236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c79263-dfb0-4c88-93b2-b802509eb8d1 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:43.485903 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 595/1216] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:43.491616 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b3087-aa75-4054-acc0-90b09323e739 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:43.560730 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:43.593431 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b3087-aa75-4054-acc0-90b09323e739 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:43.626382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72653bff-0dc7-4254-b69e-2dac5438bb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:43.627004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72653bff-0dc7-4254-b69e-2dac5438bb18 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:43.627285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72653bff-0dc7-4254-b69e-2dac5438bb18 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:43.627580 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72653bff-0dc7-4254-b69e-2dac5438bb18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:43.634108 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72653bff-0dc7-4254-b69e-2dac5438bb18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:43.635564 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72653bff-0dc7-4254-b69e-2dac5438bb18 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:43.647087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-72653bff-0dc7-4254-b69e-2dac5438bb18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:43.647087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:43.647087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:43.647087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:43.647087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:43.647087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:43.647087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:43.647087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:43.647087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:43.647087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:43.647087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:43.647087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:43.647087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:29:43.647087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:29:43.647087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:29:43.648143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:29:43.648143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:43.648143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:43.648143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:43.648143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:43.648143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:43.648143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:43.648143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:43.648143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:43.648143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:43.648143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:43.648143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:43.648143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:43.648143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:43.648143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:43.648143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:43.648143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:43.649065 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:29:43.649065 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:29:43.649065 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:29:43.649065 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:29:43.649065 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:29:43.649065 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:29:43.649065 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:43.649065 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:29:43.649065 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 622/1217] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:29:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:43.655001 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c79263-dfb0-4c88-93b2-b802509eb8d1 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:43.755248 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c79263-dfb0-4c88-93b2-b802509eb8d1 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:43.777320 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:43.788790 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a711e30-e9ee-4215-bbac-7bf612ecb12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:43.789393 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a711e30-e9ee-4215-bbac-7bf612ecb12c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:43.789674 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a711e30-e9ee-4215-bbac-7bf612ecb12c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:43.789944 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a711e30-e9ee-4215-bbac-7bf612ecb12c None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:43.790630 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a711e30-e9ee-4215-bbac-7bf612ecb12c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:43.790931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a711e30-e9ee-4215-bbac-7bf612ecb12c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:43.792390 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a711e30-e9ee-4215-bbac-7bf612ecb12c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:43.805368 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 596/1218] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 22 20:29:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:43.812361 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72653bff-0dc7-4254-b69e-2dac5438bb18 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:43.918785 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72653bff-0dc7-4254-b69e-2dac5438bb18 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:43.947811 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:43.954710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93da3e9-d6f9-4ca7-bedd-6fe732f40d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:43.955297 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93da3e9-d6f9-4ca7-bedd-6fe732f40d92 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:43.955576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93da3e9-d6f9-4ca7-bedd-6fe732f40d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:43.955843 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93da3e9-d6f9-4ca7-bedd-6fe732f40d92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:43.956563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93da3e9-d6f9-4ca7-bedd-6fe732f40d92 None admin] RBAC: Adding query filter params (role.id=38bb7e6ed5854439aeaf5996eb6892f6, scope.project.id=783c362712d34405ab827e3f00a67995, user.id=d3fdb2336b8b4f7c9b710b224a8594a0) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:43.956961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93da3e9-d6f9-4ca7-bedd-6fe732f40d92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:43.958373 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93da3e9-d6f9-4ca7-bedd-6fe732f40d92 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:43.963567 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 623/1219] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:29:43 2022] GET /identity/v3/role_assignments?user.id=d3fdb2336b8b4f7c9b710b224a8594a0&scope.project.id=783c362712d34405ab827e3f00a67995&role.id=38bb7e6ed5854439aeaf5996eb6892f6 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:45.858249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee519dd-c940-4277-9f63-c05c7199b04c None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:45.858794 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee519dd-c940-4277-9f63-c05c7199b04c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:45.858794 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee519dd-c940-4277-9f63-c05c7199b04c None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:45.860143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 597/1220] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:29:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:45.865413 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b73a4-d521-4d0f-a41a-d55107568d2d None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:45.865840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b73a4-d521-4d0f-a41a-d55107568d2d None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:45.870433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b73a4-d521-4d0f-a41a-d55107568d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:45.884303 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-4f1b73a4-d521-4d0f-a41a-d55107568d2d None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:45.885542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-4f1b73a4-d521-4d0f-a41a-d55107568d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:45.951275 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 624/1221] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:29:46.217578 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee519dd-c940-4277-9f63-c05c7199b04c None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:46.319951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee519dd-c940-4277-9f63-c05c7199b04c None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:46.353309 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636f0b5-921d-4ea4-9697-cb839495f08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:46.353921 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636f0b5-921d-4ea4-9697-cb839495f08d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:46.354196 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636f0b5-921d-4ea4-9697-cb839495f08d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:46.359749 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636f0b5-921d-4ea4-9697-cb839495f08d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:46.364261 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636f0b5-921d-4ea4-9697-cb839495f08d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:29:46.368833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-2636f0b5-921d-4ea4-9697-cb839495f08d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:29:46.368833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:46.368833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:46.368833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:46.368833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:46.368833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:46.368833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:46.368833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:46.368833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:46.368833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:46.368833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:46.368833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:46.368833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:29:46.368833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:29:46.368833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:29:46.368833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:29:46.369973 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:29:46.369973 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:29:46.369973 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:29:46.369973 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:29:46.369973 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:46.369973 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:46.369973 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:46.369973 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:46.369973 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:46.369973 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:46.369973 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:46.369973 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:46.369973 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:46.369973 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:46.369973 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:46.369973 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:46.370835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:46.370835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:46.370835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:46.370835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:46.370835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:29:46.370835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:29:46.370835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:29:46.370835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:29:46.370835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:29:46.370835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:29:46.370835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:29:46.370835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:29:46.370835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 598/1222] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 22 20:29:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:46.375984 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b73a4-d521-4d0f-a41a-d55107568d2d None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:46.472363 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b73a4-d521-4d0f-a41a-d55107568d2d None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:46.494518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:46.504721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416cc3aa-66ca-4d65-85d6-7a69a17b80a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:46.505319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416cc3aa-66ca-4d65-85d6-7a69a17b80a3 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:46.505599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416cc3aa-66ca-4d65-85d6-7a69a17b80a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:46.505865 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416cc3aa-66ca-4d65-85d6-7a69a17b80a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:46.506513 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416cc3aa-66ca-4d65-85d6-7a69a17b80a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:46.506806 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416cc3aa-66ca-4d65-85d6-7a69a17b80a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:46.508155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416cc3aa-66ca-4d65-85d6-7a69a17b80a3 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:46.516157 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 625/1223] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 22 20:29:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:46.521899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636f0b5-921d-4ea4-9697-cb839495f08d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:46.565522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:46.622781 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636f0b5-921d-4ea4-9697-cb839495f08d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:46.657123 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18778c23-f844-42c1-a840-d3c685342fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:46.657765 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18778c23-f844-42c1-a840-d3c685342fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:46.658053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18778c23-f844-42c1-a840-d3c685342fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:46.658327 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18778c23-f844-42c1-a840-d3c685342fb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:46.668127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18778c23-f844-42c1-a840-d3c685342fb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:46.670289 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18778c23-f844-42c1-a840-d3c685342fb9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:46.684533 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-18778c23-f844-42c1-a840-d3c685342fb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:46.684533 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:46.684533 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:46.684533 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:46.684533 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:46.684533 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:46.684533 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:46.684533 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:46.684533 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:46.684533 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:46.684533 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:46.684533 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:46.684533 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:46.684533 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:46.684533 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:46.684533 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:46.691417 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:46.691417 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:46.691417 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:46.691417 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:46.691417 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:46.691417 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:46.691417 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:46.691417 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:46.691417 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:46.691417 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:46.691417 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:46.691417 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:46.691417 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:46.691417 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:46.691417 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:46.691417 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:46.691417 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:46.694114 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:46.694114 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:46.694114 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:29:46.694114 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 599/1224] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:46.694418 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416cc3aa-66ca-4d65-85d6-7a69a17b80a3 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:46.790148 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416cc3aa-66ca-4d65-85d6-7a69a17b80a3 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:46.824055 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f561bc-91d4-4304-8efd-91b6077632e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:46.824649 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f561bc-91d4-4304-8efd-91b6077632e9 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:46.825273 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f561bc-91d4-4304-8efd-91b6077632e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:46.825639 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f561bc-91d4-4304-8efd-91b6077632e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:46.826267 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f561bc-91d4-4304-8efd-91b6077632e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:46.826566 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f561bc-91d4-4304-8efd-91b6077632e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:46.827954 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f561bc-91d4-4304-8efd-91b6077632e9 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:46.839579 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 626/1225] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:29:46.845775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18778c23-f844-42c1-a840-d3c685342fb9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:46.939108 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:46.946212 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18778c23-f844-42c1-a840-d3c685342fb9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:46.978672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e351c75-a849-4179-83eb-7e427b7614ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:46.979286 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e351c75-a849-4179-83eb-7e427b7614ac None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:46.979566 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e351c75-a849-4179-83eb-7e427b7614ac None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:46.979834 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e351c75-a849-4179-83eb-7e427b7614ac None admin] PATH_INFO: `/v3/users/placement` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:46.988240 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e351c75-a849-4179-83eb-7e427b7614ac None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:46.992892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e351c75-a849-4179-83eb-7e427b7614ac None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:47.000957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-1e351c75-a849-4179-83eb-7e427b7614ac None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 20:29:47.000957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:47.000957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:47.000957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:47.000957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:47.000957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:47.000957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:47.000957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:47.000957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:47.000957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:47.000957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:47.000957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:47.000957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:29:47.000957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:29:47.000957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:29:47.000957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:29:47.002090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:47.002090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:47.002090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:29:47.002090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:47.002090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:29:47.002090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:47.002090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:47.002090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:47.002090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:47.002090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:47.002090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:47.002090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:47.002090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:47.002090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:47.002090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:47.002090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:47.002090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:47.002090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:47.003168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:47.003168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:47.003168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:29:47.003168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:29:47.003168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:29:47.003168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:29:47.003168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:29:47.003168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:29:47.003168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 20:29:47.003168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:29:47.003168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 600/1226] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:47.008110 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f561bc-91d4-4304-8efd-91b6077632e9 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:47.054467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:47.108406 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f561bc-91d4-4304-8efd-91b6077632e9 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:47.140784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e45a38-e84d-4ce3-99d3-be0cd1a2b1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:47.141373 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e45a38-e84d-4ce3-99d3-be0cd1a2b1a5 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:47.141645 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e45a38-e84d-4ce3-99d3-be0cd1a2b1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:47.141910 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e45a38-e84d-4ce3-99d3-be0cd1a2b1a5 None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:47.142619 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e45a38-e84d-4ce3-99d3-be0cd1a2b1a5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:47.142914 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e45a38-e84d-4ce3-99d3-be0cd1a2b1a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:47.144322 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e45a38-e84d-4ce3-99d3-be0cd1a2b1a5 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:47.161539 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 627/1227] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Aug 22 20:29:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:47.167222 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e351c75-a849-4179-83eb-7e427b7614ac None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:47.265428 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e351c75-a849-4179-83eb-7e427b7614ac None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:47.298084 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525a9fd-bb9f-412d-867e-b07690399af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:47.298718 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525a9fd-bb9f-412d-867e-b07690399af9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:47.298991 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525a9fd-bb9f-412d-867e-b07690399af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:47.299264 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525a9fd-bb9f-412d-867e-b07690399af9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:47.309411 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c525a9fd-bb9f-412d-867e-b07690399af9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:47.311650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c525a9fd-bb9f-412d-867e-b07690399af9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:47.330809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-c525a9fd-bb9f-412d-867e-b07690399af9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:47.330809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:47.330809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:47.330809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:47.330809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:47.330809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:47.330809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:47.330809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:47.330809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:47.330809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:47.330809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:47.330809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:47.330809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:47.330809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:47.330809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:47.330809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:47.331983 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:47.331983 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:47.331983 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:47.331983 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:47.331983 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:47.331983 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:47.331983 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:47.331983 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:47.331983 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:47.331983 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:47.331983 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:47.331983 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:47.331983 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:47.331983 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:47.331983 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:47.331983 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:47.331983 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:47.332965 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:47.332965 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:47.332965 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:29:47.332965 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 601/1228] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:47.337884 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e45a38-e84d-4ce3-99d3-be0cd1a2b1a5 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:47.436700 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e45a38-e84d-4ce3-99d3-be0cd1a2b1a5 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:47.439016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:47.470327 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e028da5-eddf-48bd-a365-049f9811a272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:47.470933 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e028da5-eddf-48bd-a365-049f9811a272 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:47.471242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e028da5-eddf-48bd-a365-049f9811a272 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:47.471520 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e028da5-eddf-48bd-a365-049f9811a272 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:47.472160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e028da5-eddf-48bd-a365-049f9811a272 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:47.472465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e028da5-eddf-48bd-a365-049f9811a272 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:47.473861 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e028da5-eddf-48bd-a365-049f9811a272 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:47.485556 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 628/1229] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:47.491416 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525a9fd-bb9f-412d-867e-b07690399af9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:47.501768 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:47.595386 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525a9fd-bb9f-412d-867e-b07690399af9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:47.629862 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a158cc-6be0-42d6-b34b-8bf4a791e6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:47.630490 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a158cc-6be0-42d6-b34b-8bf4a791e6dd None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:47.630770 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a158cc-6be0-42d6-b34b-8bf4a791e6dd None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:47.631045 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a158cc-6be0-42d6-b34b-8bf4a791e6dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:47.637599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a158cc-6be0-42d6-b34b-8bf4a791e6dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:47.639625 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a158cc-6be0-42d6-b34b-8bf4a791e6dd None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:47.650515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-f6a158cc-6be0-42d6-b34b-8bf4a791e6dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:47.650515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:47.650515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:47.650515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:47.650515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:47.650515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:47.650515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:47.650515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:47.650515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:47.650515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:47.650515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:47.650515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:47.650515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:29:47.650515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:29:47.650515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:29:47.651607 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:29:47.651607 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:47.651607 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:47.651607 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:47.651607 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:47.651607 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:47.651607 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:47.651607 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:47.651607 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:47.651607 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:47.651607 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:47.651607 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:47.651607 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:47.651607 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:47.651607 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:47.651607 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:47.651607 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:47.652687 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:29:47.652687 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:29:47.652687 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:29:47.652687 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:29:47.652687 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:29:47.652687 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:29:47.652687 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:47.652687 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:29:47.652687 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 602/1230] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:29:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:47.657641 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e028da5-eddf-48bd-a365-049f9811a272 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:47.756799 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e028da5-eddf-48bd-a365-049f9811a272 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:47.789230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ecbae-6284-4be7-81c2-b1bda0219adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:47.789830 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ecbae-6284-4be7-81c2-b1bda0219adf None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:47.790107 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ecbae-6284-4be7-81c2-b1bda0219adf None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:47.790379 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ecbae-6284-4be7-81c2-b1bda0219adf None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:47.791066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ecbae-6284-4be7-81c2-b1bda0219adf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:47.791366 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ecbae-6284-4be7-81c2-b1bda0219adf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:47.792817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ecbae-6284-4be7-81c2-b1bda0219adf None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:47.806036 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 629/1231] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 22 20:29:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:47.812688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a158cc-6be0-42d6-b34b-8bf4a791e6dd None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:47.879766 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:47.913628 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a158cc-6be0-42d6-b34b-8bf4a791e6dd None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:47.948498 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e54bb-8200-46db-8499-4ca965de9273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:47.949181 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e54bb-8200-46db-8499-4ca965de9273 None admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:47.949449 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e54bb-8200-46db-8499-4ca965de9273 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:47.949720 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e54bb-8200-46db-8499-4ca965de9273 None admin] PATH_INFO: `/v3/projects/783c362712d34405ab827e3f00a67995/users/d3fdb2336b8b4f7c9b710b224a8594a0/roles/38bb7e6ed5854439aeaf5996eb6892f6` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:47.964360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e54bb-8200-46db-8499-4ca965de9273 None admin] RBAC: Authorizing `identity:create_grant(project_id=783c362712d34405ab827e3f00a67995, user_id=d3fdb2336b8b4f7c9b710b224a8594a0, role_id=38bb7e6ed5854439aeaf5996eb6892f6)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:47.966620 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e54bb-8200-46db-8499-4ca965de9273 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:48.074800 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 603/1232] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 22 20:29:47 2022] PUT /identity/v3/projects/783c362712d34405ab827e3f00a67995/users/d3fdb2336b8b4f7c9b710b224a8594a0/roles/38bb7e6ed5854439aeaf5996eb6892f6 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:29:50.001800 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746a291-88ea-4453-936c-18600eda4fa7 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:50.002412 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746a291-88ea-4453-936c-18600eda4fa7 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:50.002412 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746a291-88ea-4453-936c-18600eda4fa7 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:50.003647 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 630/1233] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:29:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:50.008928 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a16e6c-bf20-4f59-acca-a3bc1bd99701 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:50.009324 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a16e6c-bf20-4f59-acca-a3bc1bd99701 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:50.009470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a16e6c-bf20-4f59-acca-a3bc1bd99701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:50.027256 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-42a16e6c-bf20-4f59-acca-a3bc1bd99701 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:50.029867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-42a16e6c-bf20-4f59-acca-a3bc1bd99701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:50.095470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 604/1234] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:29:50.369771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746a291-88ea-4453-936c-18600eda4fa7 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:50.395236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:50.470354 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746a291-88ea-4453-936c-18600eda4fa7 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:50.505694 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b4653-e45b-4bd8-8a27-1d42b275e2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:50.506317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b4653-e45b-4bd8-8a27-1d42b275e2b1 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:50.506595 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b4653-e45b-4bd8-8a27-1d42b275e2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:50.506906 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b4653-e45b-4bd8-8a27-1d42b275e2b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:50.517564 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b4653-e45b-4bd8-8a27-1d42b275e2b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:29:50.522183 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-6e1b4653-e45b-4bd8-8a27-1d42b275e2b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:29:50.522183 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:50.522183 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:50.522183 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:50.522183 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:50.522183 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:50.522183 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:50.522183 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:50.522183 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:50.522183 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:50.522183 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:50.522183 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:50.522183 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:29:50.522183 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:29:50.522183 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:29:50.522183 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:29:50.523318 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:29:50.523318 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:29:50.523318 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:29:50.523318 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:29:50.523318 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:50.523318 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:50.523318 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:50.523318 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:50.523318 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:50.523318 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:50.523318 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:50.523318 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:50.523318 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:50.523318 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:50.523318 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:50.523318 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:50.524372 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:50.524372 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:50.524372 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:50.524372 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:50.524372 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:29:50.524372 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:29:50.524372 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:29:50.524372 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:29:50.524372 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:29:50.524372 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:29:50.524372 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 20:29:50.524372 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:29:50.524372 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 631/1235] 10.222.0.62 () {56 vars in 1102 bytes} [Mon Aug 22 20:29:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:50.531463 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a16e6c-bf20-4f59-acca-a3bc1bd99701 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:50.576015 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:50.627069 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a16e6c-bf20-4f59-acca-a3bc1bd99701 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:50.660281 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7aa28e-0b38-4722-9a0f-7637b5ef4193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:50.660981 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7aa28e-0b38-4722-9a0f-7637b5ef4193 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:50.661255 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7aa28e-0b38-4722-9a0f-7637b5ef4193 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:50.661529 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7aa28e-0b38-4722-9a0f-7637b5ef4193 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:50.662184 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7aa28e-0b38-4722-9a0f-7637b5ef4193 None admin] RBAC: Adding query filter params (name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:50.662479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7aa28e-0b38-4722-9a0f-7637b5ef4193 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:50.663843 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7aa28e-0b38-4722-9a0f-7637b5ef4193 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:50.671518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 605/1236] 10.222.0.62 () {56 vars in 1103 bytes} [Mon Aug 22 20:29:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:50.677348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b4653-e45b-4bd8-8a27-1d42b275e2b1 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:50.761017 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:50.777933 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b4653-e45b-4bd8-8a27-1d42b275e2b1 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:50.814632 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3da603-d34c-465c-a6dc-748c124b8ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:50.815251 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3da603-d34c-465c-a6dc-748c124b8ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:50.815529 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3da603-d34c-465c-a6dc-748c124b8ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:50.815864 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3da603-d34c-465c-a6dc-748c124b8ec4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:50.825909 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3da603-d34c-465c-a6dc-748c124b8ec4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:50.828190 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3da603-d34c-465c-a6dc-748c124b8ec4 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:50.843582 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-9b3da603-d34c-465c-a6dc-748c124b8ec4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:50.843582 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:50.843582 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:50.843582 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:50.843582 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:50.843582 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:50.843582 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:50.843582 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:50.843582 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:50.843582 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:50.843582 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:50.843582 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:50.843582 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:50.843582 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:50.843582 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:50.843582 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:50.849710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:50.849710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:50.849710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:50.849710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:50.849710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:50.849710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:50.849710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:50.849710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:50.849710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:50.849710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:50.849710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:50.849710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:50.849710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:50.849710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:50.849710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:50.849710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:50.849710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:50.850885 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:50.850885 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:50.850885 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:29:50.850885 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 632/1237] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:50.851186 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7aa28e-0b38-4722-9a0f-7637b5ef4193 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:50.949219 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7aa28e-0b38-4722-9a0f-7637b5ef4193 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:50.957882 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:50.982047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d65eac-3ca9-46af-9e80-d715cf32684d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:50.983155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d65eac-3ca9-46af-9e80-d715cf32684d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:50.983426 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d65eac-3ca9-46af-9e80-d715cf32684d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:50.983692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d65eac-3ca9-46af-9e80-d715cf32684d None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:50.984377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d65eac-3ca9-46af-9e80-d715cf32684d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:50.984697 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d65eac-3ca9-46af-9e80-d715cf32684d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:50.986069 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d65eac-3ca9-46af-9e80-d715cf32684d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:50.997709 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 606/1238] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:51.004208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3da603-d34c-465c-a6dc-748c124b8ec4 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:51.100861 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3da603-d34c-465c-a6dc-748c124b8ec4 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:51.136355 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58608cc9-5f47-4524-ae5b-4d5628b5183e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:51.137019 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58608cc9-5f47-4524-ae5b-4d5628b5183e None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:51.137299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58608cc9-5f47-4524-ae5b-4d5628b5183e None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:51.137569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58608cc9-5f47-4524-ae5b-4d5628b5183e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:51.140381 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:51.145413 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58608cc9-5f47-4524-ae5b-4d5628b5183e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:51.146851 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58608cc9-5f47-4524-ae5b-4d5628b5183e None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:51.159899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-58608cc9-5f47-4524-ae5b-4d5628b5183e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 20:29:51.159899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:51.159899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:51.159899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:51.159899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:51.159899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:51.159899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:51.159899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:51.159899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:51.159899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:51.159899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:51.159899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:51.159899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:29:51.159899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:29:51.159899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:29:51.159899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:29:51.161154 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:51.161154 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:51.161154 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:29:51.161154 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:51.161154 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:29:51.161154 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:51.161154 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:51.161154 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:51.161154 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:51.161154 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:51.161154 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:51.161154 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:51.161154 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:51.161154 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:51.161154 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:51.161154 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:51.161154 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:51.161154 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:51.162531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:51.162531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:51.162531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:29:51.162531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:29:51.162531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:29:51.162531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:29:51.162531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:29:51.162531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:29:51.162531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 20:29:51.162531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:29:51.162531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 633/1239] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:51.166866 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d65eac-3ca9-46af-9e80-d715cf32684d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:51.268861 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d65eac-3ca9-46af-9e80-d715cf32684d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:51.304524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a45926-7e72-405a-ba0c-68d9a964744f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:51.305177 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a45926-7e72-405a-ba0c-68d9a964744f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:51.305438 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a45926-7e72-405a-ba0c-68d9a964744f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:51.305710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a45926-7e72-405a-ba0c-68d9a964744f None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:51.306436 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a45926-7e72-405a-ba0c-68d9a964744f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:51.306813 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a45926-7e72-405a-ba0c-68d9a964744f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:51.308245 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a45926-7e72-405a-ba0c-68d9a964744f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:51.325859 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 607/1240] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Aug 22 20:29:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:51.332241 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58608cc9-5f47-4524-ae5b-4d5628b5183e None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:51.432444 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58608cc9-5f47-4524-ae5b-4d5628b5183e None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:51.465122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae098b51-e7fe-463f-a20e-54644b69de46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:51.465728 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae098b51-e7fe-463f-a20e-54644b69de46 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:51.466004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae098b51-e7fe-463f-a20e-54644b69de46 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:51.466274 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae098b51-e7fe-463f-a20e-54644b69de46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:51.527107 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:51.534088 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae098b51-e7fe-463f-a20e-54644b69de46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:51.535526 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae098b51-e7fe-463f-a20e-54644b69de46 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:51.634658 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 634/1241] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:29:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 20:29:51.640584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a45926-7e72-405a-ba0c-68d9a964744f None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:51.669348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:51.745989 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a45926-7e72-405a-ba0c-68d9a964744f None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:51.780435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc56ff0-d387-4b0c-ad8e-e3ea46aac769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:51.781073 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc56ff0-d387-4b0c-ad8e-e3ea46aac769 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:51.781355 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc56ff0-d387-4b0c-ad8e-e3ea46aac769 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:51.781629 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc56ff0-d387-4b0c-ad8e-e3ea46aac769 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:51.791597 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc56ff0-d387-4b0c-ad8e-e3ea46aac769 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:51.793196 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc56ff0-d387-4b0c-ad8e-e3ea46aac769 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:51.808403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-acc56ff0-d387-4b0c-ad8e-e3ea46aac769 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:51.808403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:51.808403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:51.808403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:51.808403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:51.808403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:51.808403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:51.808403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:51.808403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:51.808403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:51.808403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:51.808403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:51.808403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:51.808403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:51.808403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:51.808403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:51.809543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:51.809543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:51.809543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:51.809543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:51.809543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:51.809543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:51.809543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:51.809543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:51.809543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:51.809543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:51.809543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:51.809543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:51.809543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:51.809543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:51.809543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:51.809543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:51.809543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:51.811499 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:51.811499 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:51.811499 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:29:51.811499 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 608/1242] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:51.816026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae098b51-e7fe-463f-a20e-54644b69de46 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:51.909658 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:51.915244 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae098b51-e7fe-463f-a20e-54644b69de46 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:51.948907 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0bc5a-17e6-42bd-b9da-32154d64cc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:51.949497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0bc5a-17e6-42bd-b9da-32154d64cc1b None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:51.949772 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0bc5a-17e6-42bd-b9da-32154d64cc1b None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:51.950040 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0bc5a-17e6-42bd-b9da-32154d64cc1b None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:51.950668 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0bc5a-17e6-42bd-b9da-32154d64cc1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:51.950982 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0bc5a-17e6-42bd-b9da-32154d64cc1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:51.953189 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0bc5a-17e6-42bd-b9da-32154d64cc1b None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:51.964281 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 635/1243] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:51.970568 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc56ff0-d387-4b0c-ad8e-e3ea46aac769 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:52.052082 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:52.073987 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc56ff0-d387-4b0c-ad8e-e3ea46aac769 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:52.107556 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b7f3b-27e9-40fb-b99d-736d61b8c0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:52.108237 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b7f3b-27e9-40fb-b99d-736d61b8c0ec None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:52.108512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b7f3b-27e9-40fb-b99d-736d61b8c0ec None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:52.108808 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b7f3b-27e9-40fb-b99d-736d61b8c0ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:52.115401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b7f3b-27e9-40fb-b99d-736d61b8c0ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:52.116906 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b7f3b-27e9-40fb-b99d-736d61b8c0ec None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:52.129003 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-0e5b7f3b-27e9-40fb-b99d-736d61b8c0ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:52.129003 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:52.129003 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:52.129003 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:52.129003 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:52.129003 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:52.129003 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:52.129003 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:52.129003 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:52.129003 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:52.129003 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:52.129003 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:52.129003 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:29:52.129003 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:29:52.129003 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:29:52.130094 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:29:52.130094 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:52.130094 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:52.130094 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:52.130094 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:52.130094 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:52.130094 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:52.130094 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:52.130094 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:52.130094 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:52.130094 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:52.130094 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:52.130094 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:52.130094 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:52.130094 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:52.130094 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:52.130094 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:52.131228 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:29:52.131228 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:29:52.131228 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:29:52.131228 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:29:52.131228 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:29:52.131228 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:29:52.131228 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:52.131228 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:29:52.131228 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 609/1244] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:29:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:52.136156 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0bc5a-17e6-42bd-b9da-32154d64cc1b None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:52.234313 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0bc5a-17e6-42bd-b9da-32154d64cc1b None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:52.268791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d73499-2061-4e51-a572-daee5a00f10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:52.269398 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d73499-2061-4e51-a572-daee5a00f10a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:52.269678 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d73499-2061-4e51-a572-daee5a00f10a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:52.269949 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d73499-2061-4e51-a572-daee5a00f10a None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:52.270641 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d73499-2061-4e51-a572-daee5a00f10a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:52.270944 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d73499-2061-4e51-a572-daee5a00f10a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:52.272370 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d73499-2061-4e51-a572-daee5a00f10a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:52.284369 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 636/1245] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 22 20:29:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:52.290487 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b7f3b-27e9-40fb-b99d-736d61b8c0ec None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:52.391002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b7f3b-27e9-40fb-b99d-736d61b8c0ec None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:52.425441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2ae50-6add-4882-8762-4b7366a30505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:52.426043 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2ae50-6add-4882-8762-4b7366a30505 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:52.426325 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2ae50-6add-4882-8762-4b7366a30505 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:52.426690 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2ae50-6add-4882-8762-4b7366a30505 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:52.427413 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2ae50-6add-4882-8762-4b7366a30505 None admin] RBAC: Adding query filter params (role.id=38bb7e6ed5854439aeaf5996eb6892f6, scope.project.id=783c362712d34405ab827e3f00a67995, user.id=d3fdb2336b8b4f7c9b710b224a8594a0) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:52.427754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2ae50-6add-4882-8762-4b7366a30505 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:52.429433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2ae50-6add-4882-8762-4b7366a30505 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:52.435198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 610/1246] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:29:52 2022] GET /identity/v3/role_assignments?user.id=d3fdb2336b8b4f7c9b710b224a8594a0&scope.project.id=783c362712d34405ab827e3f00a67995&role.id=38bb7e6ed5854439aeaf5996eb6892f6 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:54.402525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072d0ea-49a6-467e-bbf2-c976c86211e7 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:54.403189 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072d0ea-49a6-467e-bbf2-c976c86211e7 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:54.403189 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4072d0ea-49a6-467e-bbf2-c976c86211e7 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:54.404413 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 637/1247] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:54.409774 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d44f9f-64cc-479d-83d1-b8c8bf20b183 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:54.410202 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d44f9f-64cc-479d-83d1-b8c8bf20b183 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:54.410364 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d44f9f-64cc-479d-83d1-b8c8bf20b183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:54.416526 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:54.428473 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-29d44f9f-64cc-479d-83d1-b8c8bf20b183 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:54.429668 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-29d44f9f-64cc-479d-83d1-b8c8bf20b183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:54.499917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 611/1248] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:29:54.768096 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072d0ea-49a6-467e-bbf2-c976c86211e7 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:54.788504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:54.876287 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4072d0ea-49a6-467e-bbf2-c976c86211e7 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:54.910155 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ece98-0119-4ff8-8281-bfa89e04b5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:54.910773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ece98-0119-4ff8-8281-bfa89e04b5f1 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:54.911053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ece98-0119-4ff8-8281-bfa89e04b5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:54.911327 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ece98-0119-4ff8-8281-bfa89e04b5f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:54.922944 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ece98-0119-4ff8-8281-bfa89e04b5f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:29:54.942004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-de1ece98-0119-4ff8-8281-bfa89e04b5f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:29:54.942004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:54.942004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:54.942004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:54.942004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:54.942004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:54.942004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:54.942004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:54.942004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:54.942004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:54.942004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:54.942004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:54.942004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:29:54.942004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:29:54.942004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:29:54.942004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:29:54.943160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:29:54.943160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:29:54.943160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:29:54.943160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:29:54.943160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:54.943160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:54.943160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:54.943160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:54.943160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:54.943160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:54.943160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:54.943160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:54.943160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:54.943160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:54.943160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:54.943160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:54.944187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:54.944187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:54.944187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:54.944187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:54.944187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:29:54.944187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:29:54.944187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:29:54.944187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:29:54.944187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:29:54.944187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:29:54.944187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:29:54.944187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:29:54.944187 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 638/1249] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 22 20:29:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:54.945091 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d44f9f-64cc-479d-83d1-b8c8bf20b183 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:55.032713 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d44f9f-64cc-479d-83d1-b8c8bf20b183 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:55.062439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:55.067512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c37094-bfac-4c8d-a695-99039c861ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:55.071825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c37094-bfac-4c8d-a695-99039c861ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:55.071825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c37094-bfac-4c8d-a695-99039c861ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:55.071825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c37094-bfac-4c8d-a695-99039c861ad9 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:55.071825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c37094-bfac-4c8d-a695-99039c861ad9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:55.071825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c37094-bfac-4c8d-a695-99039c861ad9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:55.071825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c37094-bfac-4c8d-a695-99039c861ad9 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:55.079071 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 612/1250] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:29:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:55.084836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ece98-0119-4ff8-8281-bfa89e04b5f1 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:55.163864 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:55.187043 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ece98-0119-4ff8-8281-bfa89e04b5f1 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:55.220698 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191eab82-a037-4eaf-85ab-14cdf59bad36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:55.221384 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191eab82-a037-4eaf-85ab-14cdf59bad36 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:55.221668 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191eab82-a037-4eaf-85ab-14cdf59bad36 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:55.221943 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191eab82-a037-4eaf-85ab-14cdf59bad36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:55.231650 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191eab82-a037-4eaf-85ab-14cdf59bad36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:55.233891 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191eab82-a037-4eaf-85ab-14cdf59bad36 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:55.247810 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-191eab82-a037-4eaf-85ab-14cdf59bad36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:55.247810 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:55.247810 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:55.247810 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:55.247810 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:55.247810 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:55.247810 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:55.247810 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:55.247810 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:55.247810 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:55.247810 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:55.247810 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:55.247810 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:55.247810 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:55.247810 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:55.247810 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:55.254298 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:55.254298 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:55.254298 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:55.254298 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:55.254298 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:55.254298 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:55.254298 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:55.254298 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:55.254298 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:55.254298 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:55.254298 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:55.254298 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:55.254298 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:55.254298 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:55.254298 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:55.254298 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:55.254298 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:55.255507 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:55.255507 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:55.255507 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:29:55.255507 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 639/1251] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 20:29:55.255784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c37094-bfac-4c8d-a695-99039c861ad9 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:55.355574 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c37094-bfac-4c8d-a695-99039c861ad9 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:55.387919 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1100857-c04c-40ed-a6db-71bec65b4204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:55.389157 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1100857-c04c-40ed-a6db-71bec65b4204 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:55.389553 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1100857-c04c-40ed-a6db-71bec65b4204 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:55.389831 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1100857-c04c-40ed-a6db-71bec65b4204 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:55.390466 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1100857-c04c-40ed-a6db-71bec65b4204 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:55.390767 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1100857-c04c-40ed-a6db-71bec65b4204 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:55.392142 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1100857-c04c-40ed-a6db-71bec65b4204 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:55.403638 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 613/1252] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:55.410123 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191eab82-a037-4eaf-85ab-14cdf59bad36 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:55.506644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191eab82-a037-4eaf-85ab-14cdf59bad36 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:55.533279 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:55.540470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b9e3c-3811-4151-8213-7444229a797a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:55.541113 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b9e3c-3811-4151-8213-7444229a797a None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:55.541392 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b9e3c-3811-4151-8213-7444229a797a None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:55.541656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b9e3c-3811-4151-8213-7444229a797a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:55.549050 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b9e3c-3811-4151-8213-7444229a797a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:55.550499 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b9e3c-3811-4151-8213-7444229a797a None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:55.561519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-849b9e3c-3811-4151-8213-7444229a797a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 20:29:55.561519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:55.561519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:55.561519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:55.561519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:55.561519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:55.561519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:55.561519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:55.561519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:55.561519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:55.561519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:55.561519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:55.561519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:29:55.561519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:29:55.561519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:29:55.561519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:29:55.562754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:55.562754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:55.562754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:29:55.562754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:55.562754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:29:55.562754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:55.562754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:55.562754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:55.562754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:55.562754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:55.562754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:55.562754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:55.562754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:55.562754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:55.562754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:55.562754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:55.562754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:55.562754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:55.563718 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:55.563718 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:55.563718 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:29:55.563718 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:29:55.563718 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:29:55.563718 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:29:55.563718 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:29:55.563718 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:29:55.563718 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 20:29:55.563718 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:29:55.563718 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 640/1253] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:55.568731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1100857-c04c-40ed-a6db-71bec65b4204 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:55.623365 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:55.666421 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1100857-c04c-40ed-a6db-71bec65b4204 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:55.699928 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a954999-fa3c-40d0-b16f-2ba42d077cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:55.700521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a954999-fa3c-40d0-b16f-2ba42d077cbe None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:55.701676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a954999-fa3c-40d0-b16f-2ba42d077cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:55.702131 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a954999-fa3c-40d0-b16f-2ba42d077cbe None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:55.702914 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a954999-fa3c-40d0-b16f-2ba42d077cbe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:55.703473 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a954999-fa3c-40d0-b16f-2ba42d077cbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:55.705497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a954999-fa3c-40d0-b16f-2ba42d077cbe None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:55.723108 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 614/1254] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Aug 22 20:29:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:55.728933 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b9e3c-3811-4151-8213-7444229a797a None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:55.828972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b9e3c-3811-4151-8213-7444229a797a None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:55.862600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761777e-f1f8-4d41-a65a-c534166dc142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:55.863193 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761777e-f1f8-4d41-a65a-c534166dc142 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:55.863471 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761777e-f1f8-4d41-a65a-c534166dc142 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:55.863742 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761777e-f1f8-4d41-a65a-c534166dc142 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:55.917791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:55.930573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761777e-f1f8-4d41-a65a-c534166dc142 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:55.932173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761777e-f1f8-4d41-a65a-c534166dc142 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:56.031500 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 641/1255] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:29:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 20:29:56.037527 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a954999-fa3c-40d0-b16f-2ba42d077cbe None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:56.136615 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a954999-fa3c-40d0-b16f-2ba42d077cbe None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:56.149562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:56.170387 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9ef11-8151-4911-8fa5-9536fd773b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:56.170916 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9ef11-8151-4911-8fa5-9536fd773b34 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:56.171181 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9ef11-8151-4911-8fa5-9536fd773b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:56.171448 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9ef11-8151-4911-8fa5-9536fd773b34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:56.181549 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b9ef11-8151-4911-8fa5-9536fd773b34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:56.182976 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b9ef11-8151-4911-8fa5-9536fd773b34 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:56.197836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-58b9ef11-8151-4911-8fa5-9536fd773b34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:56.197836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:56.197836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:56.197836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:56.197836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:56.197836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:56.197836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:56.197836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:56.197836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:56.197836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:56.197836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:56.197836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:56.197836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:56.197836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:56.197836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:56.197836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:56.198942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:56.198942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:56.198942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:56.198942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:56.198942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:56.198942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:56.198942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:56.198942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:56.198942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:56.198942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:56.198942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:56.198942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:56.198942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:56.198942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:56.198942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:56.198942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:56.198942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:56.200045 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:56.200045 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:56.200045 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:29:56.200045 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 615/1256] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:56.204953 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761777e-f1f8-4d41-a65a-c534166dc142 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:56.289618 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:56.301694 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761777e-f1f8-4d41-a65a-c534166dc142 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:56.334683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a1a54-18e7-4e67-bf80-93531c5dc4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:56.335295 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a1a54-18e7-4e67-bf80-93531c5dc4ea None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:56.335602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a1a54-18e7-4e67-bf80-93531c5dc4ea None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:56.335875 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a1a54-18e7-4e67-bf80-93531c5dc4ea None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:56.336530 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a1a54-18e7-4e67-bf80-93531c5dc4ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:56.336982 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a1a54-18e7-4e67-bf80-93531c5dc4ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:56.338346 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a1a54-18e7-4e67-bf80-93531c5dc4ea None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:56.349533 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 642/1257] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:56.355205 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9ef11-8151-4911-8fa5-9536fd773b34 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:56.454467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9ef11-8151-4911-8fa5-9536fd773b34 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:56.487433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5528e2-c8e5-4448-ad70-7d9babe12463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:56.488050 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5528e2-c8e5-4448-ad70-7d9babe12463 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:56.488326 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5528e2-c8e5-4448-ad70-7d9babe12463 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:56.488593 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5528e2-c8e5-4448-ad70-7d9babe12463 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:56.495122 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5528e2-c8e5-4448-ad70-7d9babe12463 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:56.496592 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5528e2-c8e5-4448-ad70-7d9babe12463 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:56.507423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-fc5528e2-c8e5-4448-ad70-7d9babe12463 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:56.507423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:56.507423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:56.507423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:56.507423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:56.507423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:56.507423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:56.507423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:56.507423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:56.507423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:56.507423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:56.507423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:56.507423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:29:56.507423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:29:56.507423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:29:56.508565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:29:56.508565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:56.508565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:56.508565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:56.508565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:56.508565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:56.508565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:56.508565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:56.508565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:56.508565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:56.508565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:56.508565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:56.508565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:56.508565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:56.508565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:56.508565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:56.508565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:56.516020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:29:56.516020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:29:56.516020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:29:56.516020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:29:56.516020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:29:56.516020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:29:56.516020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:29:56.516020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:29:56.516020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 616/1258] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:29:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:56.516642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a1a54-18e7-4e67-bf80-93531c5dc4ea None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:56.616394 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a1a54-18e7-4e67-bf80-93531c5dc4ea None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:56.649297 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c786259-fc04-42ed-949d-9d36a547e13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:56.649896 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c786259-fc04-42ed-949d-9d36a547e13e None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:56.650173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c786259-fc04-42ed-949d-9d36a547e13e None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:56.650442 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c786259-fc04-42ed-949d-9d36a547e13e None admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:56.651123 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c786259-fc04-42ed-949d-9d36a547e13e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:56.651422 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c786259-fc04-42ed-949d-9d36a547e13e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:56.652901 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c786259-fc04-42ed-949d-9d36a547e13e None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:56.665448 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 643/1259] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 22 20:29:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:56.672902 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5528e2-c8e5-4448-ad70-7d9babe12463 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:56.698963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:56.771528 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5528e2-c8e5-4448-ad70-7d9babe12463 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:56.805011 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995574fb-940c-4074-a501-171b95a3b438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:56.805666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995574fb-940c-4074-a501-171b95a3b438 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:56.805944 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995574fb-940c-4074-a501-171b95a3b438 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:56.806240 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995574fb-940c-4074-a501-171b95a3b438 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:56.806959 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995574fb-940c-4074-a501-171b95a3b438 None admin] RBAC: Adding query filter params (role.id=e3faa0474c054da6bb4d8910a4e40bff, scope.project.id=783c362712d34405ab827e3f00a67995, user.id=d3fdb2336b8b4f7c9b710b224a8594a0) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:56.807264 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995574fb-940c-4074-a501-171b95a3b438 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:56.808713 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995574fb-940c-4074-a501-171b95a3b438 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:56.814169 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 617/1260] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:29:56 2022] GET /identity/v3/role_assignments?user.id=d3fdb2336b8b4f7c9b710b224a8594a0&scope.project.id=783c362712d34405ab827e3f00a67995&role.id=e3faa0474c054da6bb4d8910a4e40bff => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:29:58.716938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8eaed-9f85-4811-bf71-680f560b3059 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:58.717564 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8eaed-9f85-4811-bf71-680f560b3059 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:58.717564 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8eaed-9f85-4811-bf71-680f560b3059 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:58.718815 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 644/1261] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:29:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:29:58.724044 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff975f-1a0d-425d-80e6-a308b6b586bf None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:58.724450 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff975f-1a0d-425d-80e6-a308b6b586bf None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:58.724577 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff975f-1a0d-425d-80e6-a308b6b586bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:58.743217 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-53ff975f-1a0d-425d-80e6-a308b6b586bf None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:29:58.744510 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-53ff975f-1a0d-425d-80e6-a308b6b586bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:29:58.810399 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 618/1262] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:29:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 20:29:59.077689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8eaed-9f85-4811-bf71-680f560b3059 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:59.088478 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:59.182997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8eaed-9f85-4811-bf71-680f560b3059 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:59.217173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d64dd-8919-4339-a330-68ab1a704d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:59.217789 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d64dd-8919-4339-a330-68ab1a704d80 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:59.218065 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d64dd-8919-4339-a330-68ab1a704d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:59.218333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d64dd-8919-4339-a330-68ab1a704d80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:59.227995 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d64dd-8919-4339-a330-68ab1a704d80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:29:59.232608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-1e3d64dd-8919-4339-a330-68ab1a704d80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:29:59.232608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:59.232608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:59.232608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:59.232608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:59.232608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:59.232608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:59.232608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:59.232608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:59.232608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:59.232608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:59.232608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:59.232608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:29:59.232608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:29:59.232608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:29:59.232608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:29:59.233707 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:29:59.233707 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:29:59.233707 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:29:59.233707 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:29:59.233707 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:59.233707 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:59.233707 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:59.233707 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:59.233707 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:59.233707 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:59.233707 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:59.233707 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:59.233707 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:59.233707 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:59.233707 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:59.233707 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:59.234542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:59.234542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:59.234542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:59.234542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:59.234542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:29:59.234542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:29:59.234542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:29:59.234542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:29:59.234542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:29:59.234542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:29:59.234542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:29:59.234542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:29:59.234542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 645/1263] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 22 20:29:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:59.239701 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff975f-1a0d-425d-80e6-a308b6b586bf None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:59.257987 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:59.337132 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff975f-1a0d-425d-80e6-a308b6b586bf None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:59.374609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d182a5-c493-41f5-9afc-c299ab73e849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:59.375206 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d182a5-c493-41f5-9afc-c299ab73e849 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:59.375491 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d182a5-c493-41f5-9afc-c299ab73e849 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:59.375762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d182a5-c493-41f5-9afc-c299ab73e849 None admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:59.376419 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d182a5-c493-41f5-9afc-c299ab73e849 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:59.376750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d182a5-c493-41f5-9afc-c299ab73e849 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:59.380774 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d182a5-c493-41f5-9afc-c299ab73e849 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:59.386329 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 619/1264] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:29:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:59.393009 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d64dd-8919-4339-a330-68ab1a704d80 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:59.460223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:59.491265 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d64dd-8919-4339-a330-68ab1a704d80 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:59.524541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5c1dd-1559-4b53-bbb8-d5597b38dd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:59.525175 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5c1dd-1559-4b53-bbb8-d5597b38dd39 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:59.525449 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5c1dd-1559-4b53-bbb8-d5597b38dd39 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:59.525715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5c1dd-1559-4b53-bbb8-d5597b38dd39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:59.535467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c5c1dd-1559-4b53-bbb8-d5597b38dd39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:59.536954 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c5c1dd-1559-4b53-bbb8-d5597b38dd39 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:59.551176 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-a6c5c1dd-1559-4b53-bbb8-d5597b38dd39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:59.551176 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:59.551176 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:59.551176 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:59.551176 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:59.551176 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:59.551176 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:59.551176 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:59.551176 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:59.551176 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:59.551176 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:59.551176 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:59.551176 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:29:59.551176 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:29:59.551176 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:29:59.551176 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:29:59.553292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:59.553292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:59.553292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:59.553292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:59.553292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:59.553292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:59.553292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:59.553292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:59.553292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:59.553292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:59.553292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:59.553292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:59.553292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:59.553292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:59.553292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:59.553292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:59.553292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:29:59.554489 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:29:59.554489 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:29:59.554489 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:29:59.554489 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 646/1265] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:59.558034 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d182a5-c493-41f5-9afc-c299ab73e849 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:59.640333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:59.658917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d182a5-c493-41f5-9afc-c299ab73e849 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:59.692395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d8533-321f-4a88-a3c0-bf32eed8cdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:59.693028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d8533-321f-4a88-a3c0-bf32eed8cdc3 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:59.693349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d8533-321f-4a88-a3c0-bf32eed8cdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:59.693668 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d8533-321f-4a88-a3c0-bf32eed8cdc3 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:59.694299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d8533-321f-4a88-a3c0-bf32eed8cdc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:29:59.694593 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d8533-321f-4a88-a3c0-bf32eed8cdc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:59.695998 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d8533-321f-4a88-a3c0-bf32eed8cdc3 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:59.707992 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 620/1266] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:29:59.713724 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5c1dd-1559-4b53-bbb8-d5597b38dd39 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:59.815432 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5c1dd-1559-4b53-bbb8-d5597b38dd39 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:29:59.835696 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:29:59.849858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35daaa9a-39b5-4414-a9cf-e5251be8bd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:29:59.850476 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35daaa9a-39b5-4414-a9cf-e5251be8bd4d None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:29:59.850778 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35daaa9a-39b5-4414-a9cf-e5251be8bd4d None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:29:59.851048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35daaa9a-39b5-4414-a9cf-e5251be8bd4d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:29:59.858968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35daaa9a-39b5-4414-a9cf-e5251be8bd4d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:29:59.860384 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35daaa9a-39b5-4414-a9cf-e5251be8bd4d None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:29:59.871143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-35daaa9a-39b5-4414-a9cf-e5251be8bd4d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 20:29:59.871143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:29:59.871143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:29:59.871143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:29:59.871143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:29:59.871143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:29:59.871143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:29:59.871143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:29:59.871143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:29:59.871143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:29:59.871143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:29:59.871143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:29:59.871143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:29:59.871143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:29:59.871143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:29:59.871143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:29:59.877738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:29:59.877738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:29:59.877738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:29:59.877738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:59.877738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:29:59.877738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:29:59.877738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:29:59.877738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:29:59.877738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:29:59.877738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:29:59.877738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:29:59.877738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:29:59.877738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:29:59.877738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:29:59.877738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:29:59.877738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:29:59.877738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:29:59.877738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:29:59.878845 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:29:59.878845 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:29:59.878845 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:29:59.878845 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:29:59.878845 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:29:59.878845 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:29:59.878845 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:29:59.878845 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:29:59.878845 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 20:29:59.878845 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:29:59.878845 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 647/1267] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:29:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:29:59.879618 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d8533-321f-4a88-a3c0-bf32eed8cdc3 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:29:59.979108 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d8533-321f-4a88-a3c0-bf32eed8cdc3 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:00.012944 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce4b58-e6a0-4235-94d4-1bd88f8dca19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:00.013497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce4b58-e6a0-4235-94d4-1bd88f8dca19 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:00.013846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce4b58-e6a0-4235-94d4-1bd88f8dca19 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:00.014110 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce4b58-e6a0-4235-94d4-1bd88f8dca19 None admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:00.014828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce4b58-e6a0-4235-94d4-1bd88f8dca19 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:30:00.015129 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce4b58-e6a0-4235-94d4-1bd88f8dca19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:00.016548 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce4b58-e6a0-4235-94d4-1bd88f8dca19 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:00.024997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:00.033249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 621/1268] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Aug 22 20:29:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:30:00.039064 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35daaa9a-39b5-4414-a9cf-e5251be8bd4d None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:00.140378 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35daaa9a-39b5-4414-a9cf-e5251be8bd4d None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:00.174183 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177f82d-178c-44fc-b065-967883639e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:00.174803 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177f82d-178c-44fc-b065-967883639e41 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:00.175082 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177f82d-178c-44fc-b065-967883639e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:00.175353 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177f82d-178c-44fc-b065-967883639e41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:00.186048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177f82d-178c-44fc-b065-967883639e41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:00.187490 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177f82d-178c-44fc-b065-967883639e41 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:00.201535 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-9177f82d-178c-44fc-b065-967883639e41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:30:00.201535 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:30:00.201535 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:30:00.201535 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:30:00.201535 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:30:00.201535 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:30:00.201535 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:30:00.201535 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:30:00.201535 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:30:00.201535 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:30:00.201535 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:30:00.201535 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:30:00.201535 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:30:00.201535 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:30:00.201535 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:30:00.201535 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:30:00.206051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:30:00.206051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:30:00.206051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:30:00.206051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:30:00.206051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:30:00.206051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:30:00.206051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:30:00.206051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:30:00.206051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:30:00.206051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:30:00.206051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:30:00.206051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:30:00.206051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:30:00.206051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:30:00.206051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:30:00.206051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:30:00.206051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:30:00.207143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:30:00.207143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:30:00.207143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:30:00.207143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 648/1269] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:30:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:30:00.208814 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce4b58-e6a0-4235-94d4-1bd88f8dca19 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:00.308997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce4b58-e6a0-4235-94d4-1bd88f8dca19 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:00.349167 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea954d14-ab2e-4f58-91c4-c1ecf62f8034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:00.349804 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea954d14-ab2e-4f58-91c4-c1ecf62f8034 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:00.350080 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea954d14-ab2e-4f58-91c4-c1ecf62f8034 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:00.350347 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea954d14-ab2e-4f58-91c4-c1ecf62f8034 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:00.351014 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea954d14-ab2e-4f58-91c4-c1ecf62f8034 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:30:00.351312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea954d14-ab2e-4f58-91c4-c1ecf62f8034 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:00.352740 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea954d14-ab2e-4f58-91c4-c1ecf62f8034 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:00.369627 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 622/1270] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:30:00.370979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177f82d-178c-44fc-b065-967883639e41 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:00.401746 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:00.469007 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177f82d-178c-44fc-b065-967883639e41 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:00.501818 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4d9c1-6b16-40eb-9380-254099d790b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:00.502441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4d9c1-6b16-40eb-9380-254099d790b5 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:00.502716 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4d9c1-6b16-40eb-9380-254099d790b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:00.502984 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4d9c1-6b16-40eb-9380-254099d790b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:00.509327 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4d9c1-6b16-40eb-9380-254099d790b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:00.510775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4d9c1-6b16-40eb-9380-254099d790b5 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:00.522494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-a4b4d9c1-6b16-40eb-9380-254099d790b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:30:00.522494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:30:00.522494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:30:00.522494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:30:00.522494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:30:00.522494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:30:00.522494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:30:00.522494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:30:00.522494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:30:00.522494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:30:00.522494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:30:00.522494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:30:00.522494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:30:00.522494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:30:00.522494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:30:00.531714 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:30:00.531714 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:30:00.531714 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:30:00.531714 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:30:00.531714 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:30:00.531714 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:30:00.531714 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:30:00.531714 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:30:00.531714 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:30:00.531714 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:30:00.531714 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:30:00.531714 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:30:00.531714 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:30:00.531714 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:30:00.531714 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:30:00.531714 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:30:00.531714 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:30:00.532858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:30:00.532858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:30:00.532858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:30:00.532858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:30:00.532858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:30:00.532858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:30:00.532858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:30:00.532858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:30:00.532858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 649/1271] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:30:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:30:00.533459 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea954d14-ab2e-4f58-91c4-c1ecf62f8034 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:00.594716 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:00.635502 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea954d14-ab2e-4f58-91c4-c1ecf62f8034 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:00.669369 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560d87f-d8fe-4652-90b2-0fa74f7d3f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:00.669929 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560d87f-d8fe-4652-90b2-0fa74f7d3f0f None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:00.670218 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560d87f-d8fe-4652-90b2-0fa74f7d3f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:00.670481 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560d87f-d8fe-4652-90b2-0fa74f7d3f0f None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:00.671162 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560d87f-d8fe-4652-90b2-0fa74f7d3f0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:30:00.671467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560d87f-d8fe-4652-90b2-0fa74f7d3f0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:00.672960 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560d87f-d8fe-4652-90b2-0fa74f7d3f0f None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:00.686712 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 623/1272] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 22 20:30:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:30:00.692305 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4d9c1-6b16-40eb-9380-254099d790b5 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:00.783804 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:00.792427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4d9c1-6b16-40eb-9380-254099d790b5 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:00.827388 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b5710-ed12-49f2-a6fd-a2f7e9b72c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:00.828036 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b5710-ed12-49f2-a6fd-a2f7e9b72c39 None admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:00.828310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b5710-ed12-49f2-a6fd-a2f7e9b72c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:00.828577 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b5710-ed12-49f2-a6fd-a2f7e9b72c39 None admin] PATH_INFO: `/v3/projects/783c362712d34405ab827e3f00a67995/users/d3fdb2336b8b4f7c9b710b224a8594a0/roles/e3faa0474c054da6bb4d8910a4e40bff` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:00.830470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b5710-ed12-49f2-a6fd-a2f7e9b72c39 None admin] RBAC: Authorizing `identity:create_grant(project_id=783c362712d34405ab827e3f00a67995, user_id=d3fdb2336b8b4f7c9b710b224a8594a0, role_id=e3faa0474c054da6bb4d8910a4e40bff)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:00.831883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b5710-ed12-49f2-a6fd-a2f7e9b72c39 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:00.906918 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 650/1273] 10.222.0.62 () {58 vars in 1439 bytes} [Mon Aug 22 20:30:00 2022] PUT /identity/v3/projects/783c362712d34405ab827e3f00a67995/users/d3fdb2336b8b4f7c9b710b224a8594a0/roles/e3faa0474c054da6bb4d8910a4e40bff => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:30:02.855753 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7b487-531b-4c07-a17c-99efc1dcb6bf None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:02.856339 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7b487-531b-4c07-a17c-99efc1dcb6bf None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:02.856339 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7b487-531b-4c07-a17c-99efc1dcb6bf None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:02.858576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 624/1274] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:30:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:30:02.863827 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20546fce-6b9f-4c84-84b0-bb2c60b533fa None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:02.864267 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20546fce-6b9f-4c84-84b0-bb2c60b533fa None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:02.864361 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20546fce-6b9f-4c84-84b0-bb2c60b533fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:02.883249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-20546fce-6b9f-4c84-84b0-bb2c60b533fa None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:30:02.884495 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-20546fce-6b9f-4c84-84b0-bb2c60b533fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:30:02.951276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 651/1275] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:30:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:30:03.220102 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7b487-531b-4c07-a17c-99efc1dcb6bf None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:03.322618 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7b487-531b-4c07-a17c-99efc1dcb6bf None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:03.339968 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:03.357774 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702778b0-b928-4529-ade7-3d1f6a374262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:03.358386 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702778b0-b928-4529-ade7-3d1f6a374262 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:03.358666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702778b0-b928-4529-ade7-3d1f6a374262 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:03.358933 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702778b0-b928-4529-ade7-3d1f6a374262 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:03.368693 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702778b0-b928-4529-ade7-3d1f6a374262 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 20:30:03.373492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-702778b0-b928-4529-ade7-3d1f6a374262 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:30:03.373492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:30:03.373492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:30:03.373492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:30:03.373492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:30:03.373492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:30:03.373492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:30:03.373492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:30:03.373492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:30:03.373492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:30:03.373492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:30:03.373492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:30:03.373492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 20:30:03.373492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 20:30:03.373492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 20:30:03.373492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 20:30:03.374602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 20:30:03.374602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 20:30:03.374602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 20:30:03.374602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 20:30:03.374602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:30:03.374602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:30:03.374602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:30:03.374602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:30:03.374602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:30:03.374602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:30:03.374602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:30:03.374602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:30:03.374602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:30:03.374602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:30:03.374602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:30:03.374602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:30:03.375617 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:30:03.375617 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:30:03.375617 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:30:03.375617 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:30:03.375617 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 20:30:03.375617 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 20:30:03.375617 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 20:30:03.375617 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 20:30:03.375617 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 20:30:03.375617 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 20:30:03.375617 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 20:30:03.375617 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:30:03.375617 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 625/1276] 10.222.0.62 () {56 vars in 1096 bytes} [Mon Aug 22 20:30:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:30:03.380616 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20546fce-6b9f-4c84-84b0-bb2c60b533fa None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:03.461878 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:03.479717 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20546fce-6b9f-4c84-84b0-bb2c60b533fa None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:03.512236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59415c33-fafb-410d-ad67-ddac97914fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:03.512979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59415c33-fafb-410d-ad67-ddac97914fa4 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:03.513252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59415c33-fafb-410d-ad67-ddac97914fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:03.513522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59415c33-fafb-410d-ad67-ddac97914fa4 None admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:03.514171 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59415c33-fafb-410d-ad67-ddac97914fa4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:30:03.514469 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59415c33-fafb-410d-ad67-ddac97914fa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:03.515825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59415c33-fafb-410d-ad67-ddac97914fa4 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:03.523515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 652/1277] 10.222.0.62 () {56 vars in 1099 bytes} [Mon Aug 22 20:30:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:30:03.529804 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702778b0-b928-4529-ade7-3d1f6a374262 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:03.629423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702778b0-b928-4529-ade7-3d1f6a374262 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:03.663434 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485fa40-8f8b-4bf7-8118-fecf91ced12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:03.664056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485fa40-8f8b-4bf7-8118-fecf91ced12d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:03.664334 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485fa40-8f8b-4bf7-8118-fecf91ced12d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:03.664602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485fa40-8f8b-4bf7-8118-fecf91ced12d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:03.674812 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6485fa40-8f8b-4bf7-8118-fecf91ced12d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:03.676305 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6485fa40-8f8b-4bf7-8118-fecf91ced12d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:03.690377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-6485fa40-8f8b-4bf7-8118-fecf91ced12d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:30:03.690377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:30:03.690377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:30:03.690377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:30:03.690377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:30:03.690377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:30:03.690377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:30:03.690377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:30:03.690377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:30:03.690377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:30:03.690377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:30:03.690377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:30:03.690377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:30:03.690377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:30:03.690377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:30:03.690377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:30:03.691791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:30:03.691791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:30:03.691791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:30:03.691791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:30:03.691791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:30:03.691791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:30:03.691791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:30:03.691791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:30:03.691791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:30:03.691791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:30:03.691791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:30:03.691791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:30:03.691791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:30:03.691791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:30:03.691791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:30:03.691791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:30:03.691791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:30:03.699251 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:30:03.699251 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:30:03.699251 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:30:03.699251 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 626/1278] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:30:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:30:03.699564 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59415c33-fafb-410d-ad67-ddac97914fa4 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:03.800038 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59415c33-fafb-410d-ad67-ddac97914fa4 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:03.834476 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da6288-e3d0-42c0-bc12-1a81abdd4142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:03.835082 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da6288-e3d0-42c0-bc12-1a81abdd4142 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:03.835363 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da6288-e3d0-42c0-bc12-1a81abdd4142 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:03.835634 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da6288-e3d0-42c0-bc12-1a81abdd4142 None admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:03.836272 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da6288-e3d0-42c0-bc12-1a81abdd4142 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:30:03.836575 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da6288-e3d0-42c0-bc12-1a81abdd4142 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:03.837993 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da6288-e3d0-42c0-bc12-1a81abdd4142 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:03.850642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 653/1279] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:30:03.856416 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485fa40-8f8b-4bf7-8118-fecf91ced12d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:03.886503 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:03.957503 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485fa40-8f8b-4bf7-8118-fecf91ced12d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:03.990973 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed8fd9-a83f-44a6-a6a5-2ebaf0be094d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:03.991873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed8fd9-a83f-44a6-a6a5-2ebaf0be094d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:03.992152 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed8fd9-a83f-44a6-a6a5-2ebaf0be094d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:03.992422 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed8fd9-a83f-44a6-a6a5-2ebaf0be094d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:04.000687 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed8fd9-a83f-44a6-a6a5-2ebaf0be094d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:04.002238 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed8fd9-a83f-44a6-a6a5-2ebaf0be094d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:04.014055 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-87ed8fd9-a83f-44a6-a6a5-2ebaf0be094d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 20:30:04.014055 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:30:04.014055 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:30:04.014055 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:30:04.014055 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:30:04.014055 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:30:04.014055 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:30:04.014055 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:30:04.014055 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:30:04.014055 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:30:04.014055 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:30:04.014055 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:30:04.014055 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 20:30:04.014055 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 20:30:04.014055 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 20:30:04.014055 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 20:30:04.015494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:30:04.015494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:30:04.015494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 20:30:04.015494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:30:04.015494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 20:30:04.015494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 20:30:04.015494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:30:04.015494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:30:04.015494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:30:04.015494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:30:04.015494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:30:04.015494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:30:04.015494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:30:04.015494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:30:04.015494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:30:04.015494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:30:04.015494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:30:04.015494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:30:04.016683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:30:04.016683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:30:04.016683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 20:30:04.016683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 20:30:04.016683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 20:30:04.016683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 20:30:04.016683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 20:30:04.016683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 20:30:04.016683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 20:30:04.016683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:30:04.016683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 627/1280] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:30:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:30:04.021314 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da6288-e3d0-42c0-bc12-1a81abdd4142 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:04.025223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:04.122732 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da6288-e3d0-42c0-bc12-1a81abdd4142 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:04.155528 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ddbc44-7a04-41d3-bb96-592c6debf4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:04.156127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddbc44-7a04-41d3-bb96-592c6debf4de None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:04.163661 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddbc44-7a04-41d3-bb96-592c6debf4de None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:04.163661 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ddbc44-7a04-41d3-bb96-592c6debf4de None admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:04.163661 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ddbc44-7a04-41d3-bb96-592c6debf4de None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:30:04.163661 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ddbc44-7a04-41d3-bb96-592c6debf4de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:04.163661 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ddbc44-7a04-41d3-bb96-592c6debf4de None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:04.177067 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 654/1281] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Aug 22 20:30:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:30:04.182948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed8fd9-a83f-44a6-a6a5-2ebaf0be094d None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:04.275901 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:04.285670 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed8fd9-a83f-44a6-a6a5-2ebaf0be094d None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:04.318963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f893f-0ae0-4788-8b59-e1f2f2dbbf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:04.319561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f893f-0ae0-4788-8b59-e1f2f2dbbf03 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:04.319841 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f893f-0ae0-4788-8b59-e1f2f2dbbf03 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:04.320140 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f893f-0ae0-4788-8b59-e1f2f2dbbf03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:04.386963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f893f-0ae0-4788-8b59-e1f2f2dbbf03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:04.388951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f893f-0ae0-4788-8b59-e1f2f2dbbf03 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:04.475717 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:04.486211 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 628/1282] 10.222.0.62 () {58 vars in 1282 bytes} [Mon Aug 22 20:30:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 20:30:04.492084 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ddbc44-7a04-41d3-bb96-592c6debf4de None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:04.552224 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:04.589473 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ddbc44-7a04-41d3-bb96-592c6debf4de None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:04.621687 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3605a05-3dde-494d-b8ac-6c4affd464b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:04.623026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3605a05-3dde-494d-b8ac-6c4affd464b8 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:04.623308 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3605a05-3dde-494d-b8ac-6c4affd464b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:04.623584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3605a05-3dde-494d-b8ac-6c4affd464b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:04.633751 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3605a05-3dde-494d-b8ac-6c4affd464b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:04.635196 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3605a05-3dde-494d-b8ac-6c4affd464b8 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:04.648883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-e3605a05-3dde-494d-b8ac-6c4affd464b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:30:04.648883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:30:04.648883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:30:04.648883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:30:04.648883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:30:04.648883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:30:04.648883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:30:04.648883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:30:04.648883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:30:04.648883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:30:04.648883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:30:04.648883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:30:04.648883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 20:30:04.648883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 20:30:04.648883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 20:30:04.648883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 20:30:04.650166 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:30:04.650166 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:30:04.650166 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:30:04.650166 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:30:04.650166 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:30:04.650166 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:30:04.650166 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:30:04.650166 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:30:04.650166 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:30:04.650166 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:30:04.650166 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:30:04.650166 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:30:04.650166 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:30:04.650166 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:30:04.650166 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:30:04.650166 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:30:04.650166 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 20:30:04.651157 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 20:30:04.651157 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 20:30:04.651157 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:30:04.651157 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 655/1283] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:30:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:30:04.656965 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f893f-0ae0-4788-8b59-e1f2f2dbbf03 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:04.755777 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f893f-0ae0-4788-8b59-e1f2f2dbbf03 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:04.789412 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c9d475-9129-417d-91c4-2473d6061fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:04.790018 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9d475-9129-417d-91c4-2473d6061fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:04.790293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9d475-9129-417d-91c4-2473d6061fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:04.790564 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9d475-9129-417d-91c4-2473d6061fc3 None admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:04.791239 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c9d475-9129-417d-91c4-2473d6061fc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:30:04.791536 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c9d475-9129-417d-91c4-2473d6061fc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:04.792942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c9d475-9129-417d-91c4-2473d6061fc3 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:04.804891 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 629/1284] 10.222.0.62 () {56 vars in 1109 bytes} [Mon Aug 22 20:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:30:04.810829 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3605a05-3dde-494d-b8ac-6c4affd464b8 None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:04.910430 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3605a05-3dde-494d-b8ac-6c4affd464b8 None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:04.924049 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:04.943869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e32b1-c25b-43cc-bb58-7d33ca6645df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:04.944467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e32b1-c25b-43cc-bb58-7d33ca6645df None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:04.944772 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e32b1-c25b-43cc-bb58-7d33ca6645df None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:04.945042 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e32b1-c25b-43cc-bb58-7d33ca6645df None admin] PATH_INFO: `/v3/projects/service` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:04.952232 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e32b1-c25b-43cc-bb58-7d33ca6645df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:04.953672 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e32b1-c25b-43cc-bb58-7d33ca6645df None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:04.964442 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application [None req-fc4e32b1-c25b-43cc-bb58-7d33ca6645df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:30:04.964442 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:30:04.964442 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:30:04.964442 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:30:04.964442 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:30:04.964442 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:30:04.964442 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:30:04.964442 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:30:04.964442 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:30:04.964442 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:30:04.964442 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:30:04.964442 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:30:04.964442 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 20:30:04.964442 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 20:30:04.964442 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 20:30:04.967319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 20:30:04.967319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:30:04.967319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:30:04.967319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:30:04.967319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:30:04.967319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:30:04.967319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:30:04.967319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:30:04.967319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application with Lock( Aug 22 20:30:04.967319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:30:04.967319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:30:04.967319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:30:04.967319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:30:04.967319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:30:04.967319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:30:04.967319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:30:04.967319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:30:04.968213 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 20:30:04.968213 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 20:30:04.968213 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 20:30:04.968213 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 20:30:04.968213 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 20:30:04.968213 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 20:30:04.968213 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 20:30:04.968213 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: ERROR keystone.server.flask.application Aug 22 20:30:04.968213 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 656/1285] 10.222.0.62 () {56 vars in 1111 bytes} [Mon Aug 22 20:30:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:30:04.972161 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c9d475-9129-417d-91c4-2473d6061fc3 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:05.021725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:05.078377 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c9d475-9129-417d-91c4-2473d6061fc3 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:05.111321 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f113c-c4a8-4b69-aa42-f6758e55e398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:05.111920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f113c-c4a8-4b69-aa42-f6758e55e398 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:05.112195 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f113c-c4a8-4b69-aa42-f6758e55e398 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:05.112464 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f113c-c4a8-4b69-aa42-f6758e55e398 None admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:05.113177 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f113c-c4a8-4b69-aa42-f6758e55e398 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:30:05.113477 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f113c-c4a8-4b69-aa42-f6758e55e398 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:05.114901 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f113c-c4a8-4b69-aa42-f6758e55e398 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:05.127238 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 630/1286] 10.222.0.62 () {56 vars in 1148 bytes} [Mon Aug 22 20:30:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:30:05.133465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e32b1-c25b-43cc-bb58-7d33ca6645df None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:05.236951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e32b1-c25b-43cc-bb58-7d33ca6645df None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:05.270411 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a52d5e-f5a7-4701-b206-7c622823391b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:05.271003 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a52d5e-f5a7-4701-b206-7c622823391b None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:05.271278 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a52d5e-f5a7-4701-b206-7c622823391b None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:05.271543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a52d5e-f5a7-4701-b206-7c622823391b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:05.272246 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a52d5e-f5a7-4701-b206-7c622823391b None admin] RBAC: Adding query filter params (role.id=e3faa0474c054da6bb4d8910a4e40bff, scope.project.id=783c362712d34405ab827e3f00a67995, user.id=d3fdb2336b8b4f7c9b710b224a8594a0) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:30:05.272547 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a52d5e-f5a7-4701-b206-7c622823391b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:05.273979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a52d5e-f5a7-4701-b206-7c622823391b None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:05.279716 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 657/1287] 10.222.0.62 () {56 vars in 1374 bytes} [Mon Aug 22 20:30:05 2022] GET /identity/v3/role_assignments?user.id=d3fdb2336b8b4f7c9b710b224a8594a0&scope.project.id=783c362712d34405ab827e3f00a67995&role.id=e3faa0474c054da6bb4d8910a4e40bff => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:30:07.195484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561df16c-f06c-4ce0-95ae-ef36beefe4e7 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:07.196068 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561df16c-f06c-4ce0-95ae-ef36beefe4e7 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:07.196068 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561df16c-f06c-4ce0-95ae-ef36beefe4e7 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:07.197373 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 631/1288] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:30:07.203352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6eaf8e-d897-4507-900b-d36a799e18df None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:07.203787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6eaf8e-d897-4507-900b-d36a799e18df None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:07.203930 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6eaf8e-d897-4507-900b-d36a799e18df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:07.222057 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-8b6eaf8e-d897-4507-900b-d36a799e18df None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:30:07.223280 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-8b6eaf8e-d897-4507-900b-d36a799e18df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:30:07.253150 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:07.291154 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 658/1289] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:30:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:30:07.582768 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561df16c-f06c-4ce0-95ae-ef36beefe4e7 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:07.685581 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561df16c-f06c-4ce0-95ae-ef36beefe4e7 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:07.696928 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:07.722384 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158da99-56f6-4c9e-a4a2-8673e273e74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:07.723043 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158da99-56f6-4c9e-a4a2-8673e273e74c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:07.724500 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158da99-56f6-4c9e-a4a2-8673e273e74c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:07.724500 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158da99-56f6-4c9e-a4a2-8673e273e74c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:07.724500 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158da99-56f6-4c9e-a4a2-8673e273e74c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:07.725680 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158da99-56f6-4c9e-a4a2-8673e273e74c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:07.735941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-2158da99-56f6-4c9e-a4a2-8673e273e74c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 20:30:07.735941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:30:07.735941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:30:07.735941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:30:07.735941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:30:07.735941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:30:07.735941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:30:07.735941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:30:07.735941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 20:30:07.735941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:30:07.735941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:30:07.735941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:30:07.735941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:30:07.735941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:30:07.735941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:30:07.735941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:30:07.735941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:30:07.737317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:30:07.737317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:30:07.737317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:30:07.737317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:30:07.737317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:30:07.737317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:30:07.737317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:30:07.737317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:30:07.737317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:30:07.737317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:30:07.737317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:30:07.737317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:30:07.737317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:30:07.737317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:30:07.737317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:30:07.737317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:30:07.738299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:30:07.738299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:30:07.738299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:30:07.738299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:30:07.738299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:30:07.738299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:30:07.738299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:30:07.738299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:30:07.738299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:30:07.738299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:30:07.738299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:30:07.738299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:30:07.738299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 20:30:07.738299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:30:07.738299 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 632/1290] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Aug 22 20:30:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:30:07.743559 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6eaf8e-d897-4507-900b-d36a799e18df None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:07.855796 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6eaf8e-d897-4507-900b-d36a799e18df None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:07.893965 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2383d-79a8-4d86-a63b-aa539e4c11e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:07.894629 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2383d-79a8-4d86-a63b-aa539e4c11e9 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:07.894911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2383d-79a8-4d86-a63b-aa539e4c11e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:07.895179 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2383d-79a8-4d86-a63b-aa539e4c11e9 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:07.895831 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2383d-79a8-4d86-a63b-aa539e4c11e9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:30:07.896119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2383d-79a8-4d86-a63b-aa539e4c11e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:07.897529 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2383d-79a8-4d86-a63b-aa539e4c11e9 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:07.908963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 659/1291] 10.222.0.62 () {56 vars in 1116 bytes} [Mon Aug 22 20:30:07 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:30:07.910222 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158da99-56f6-4c9e-a4a2-8673e273e74c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:08.020475 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158da99-56f6-4c9e-a4a2-8673e273e74c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:08.057114 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46889e0-f4c8-4ff5-8e33-1664ae7bba0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:08.057721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46889e0-f4c8-4ff5-8e33-1664ae7bba0d None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:08.058002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46889e0-f4c8-4ff5-8e33-1664ae7bba0d None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:08.058281 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46889e0-f4c8-4ff5-8e33-1664ae7bba0d None admin] PATH_INFO: `/v3/services` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:08.058910 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46889e0-f4c8-4ff5-8e33-1664ae7bba0d None admin] RBAC: Adding query filter params (type=placement) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:30:08.059832 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46889e0-f4c8-4ff5-8e33-1664ae7bba0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:08.061279 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46889e0-f4c8-4ff5-8e33-1664ae7bba0d None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:08.066144 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 633/1292] 10.222.0.62 () {56 vars in 1116 bytes} [Mon Aug 22 20:30:07 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:30:09.983854 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f8f9c-0380-424a-a83c-1315c810a3cf None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:09.984380 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f8f9c-0380-424a-a83c-1315c810a3cf None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:09.984380 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f8f9c-0380-424a-a83c-1315c810a3cf None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:09.985754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 660/1293] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:30:09.991105 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59953c8-6dfe-4c6e-8c82-a53f66c1e4b8 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:09.991538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59953c8-6dfe-4c6e-8c82-a53f66c1e4b8 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:09.991632 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59953c8-6dfe-4c6e-8c82-a53f66c1e4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:10.010747 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-a59953c8-6dfe-4c6e-8c82-a53f66c1e4b8 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:30:10.012698 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a59953c8-6dfe-4c6e-8c82-a53f66c1e4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:30:10.041452 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:10.079620 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 634/1294] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:30:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:30:10.352907 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f8f9c-0380-424a-a83c-1315c810a3cf None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:10.384368 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:10.454573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f8f9c-0380-424a-a83c-1315c810a3cf None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:10.488385 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e9aba-2ad0-4c14-930b-0c97e0fe4c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:10.489011 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e9aba-2ad0-4c14-930b-0c97e0fe4c20 None admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:10.489292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e9aba-2ad0-4c14-930b-0c97e0fe4c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:10.489565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e9aba-2ad0-4c14-930b-0c97e0fe4c20 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:10.490212 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e9aba-2ad0-4c14-930b-0c97e0fe4c20 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:10.491569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e9aba-2ad0-4c14-930b-0c97e0fe4c20 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:10.601923 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 661/1295] 10.222.0.62 () {60 vars in 1141 bytes} [Mon Aug 22 20:30:10 2022] POST /identity/v3/services => generated 246 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:30:12.508335 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef590d5-a2ef-4826-ba35-65cc926a35db None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:12.508897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef590d5-a2ef-4826-ba35-65cc926a35db None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:12.508897 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef590d5-a2ef-4826-ba35-65cc926a35db None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:12.510225 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 635/1296] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:30:12.515958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0b281-a73b-4a0c-8db8-494f0ff7d938 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:12.516354 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0b281-a73b-4a0c-8db8-494f0ff7d938 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:12.516499 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0b281-a73b-4a0c-8db8-494f0ff7d938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:12.534371 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-9ca0b281-a73b-4a0c-8db8-494f0ff7d938 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:30:12.538511 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-9ca0b281-a73b-4a0c-8db8-494f0ff7d938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:30:12.610490 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 662/1297] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:30:12 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:30:12.883091 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef590d5-a2ef-4826-ba35-65cc926a35db None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:12.987307 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef590d5-a2ef-4826-ba35-65cc926a35db None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:13.020070 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945e3af-b399-4c28-b75d-cf1216bad35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:13.020705 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945e3af-b399-4c28-b75d-cf1216bad35c None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:13.020987 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945e3af-b399-4c28-b75d-cf1216bad35c None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:13.021256 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945e3af-b399-4c28-b75d-cf1216bad35c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:13.021846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945e3af-b399-4c28-b75d-cf1216bad35c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:13.023202 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945e3af-b399-4c28-b75d-cf1216bad35c None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:13.032526 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-2945e3af-b399-4c28-b75d-cf1216bad35c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 20:30:13.032526 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:30:13.032526 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:30:13.032526 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:30:13.032526 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:30:13.032526 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:30:13.032526 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:30:13.032526 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:30:13.032526 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 20:30:13.032526 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:30:13.032526 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:30:13.032526 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:30:13.032526 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:30:13.032526 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:30:13.032526 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:30:13.032526 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:30:13.032526 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:30:13.033695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:30:13.033695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:30:13.033695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:30:13.033695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:30:13.033695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:30:13.033695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:30:13.033695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:30:13.033695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:30:13.033695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:30:13.033695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:30:13.033695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:30:13.033695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:30:13.033695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:30:13.033695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:30:13.033695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:30:13.033695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:30:13.034685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:30:13.034685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:30:13.034685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:30:13.034685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:30:13.034685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:30:13.034685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:30:13.034685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:30:13.034685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:30:13.034685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:30:13.034685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:30:13.034685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:30:13.034685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:30:13.034685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 20:30:13.034685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:30:13.034685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 636/1298] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Aug 22 20:30:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:30:13.039662 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0b281-a73b-4a0c-8db8-494f0ff7d938 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:13.058034 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:13.139315 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0b281-a73b-4a0c-8db8-494f0ff7d938 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:13.172808 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2c754-f7ee-4d9d-a3cc-09b1dc93ffaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:13.173406 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2c754-f7ee-4d9d-a3cc-09b1dc93ffaa None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:13.173685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2c754-f7ee-4d9d-a3cc-09b1dc93ffaa None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:13.173957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2c754-f7ee-4d9d-a3cc-09b1dc93ffaa None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:13.174581 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2c754-f7ee-4d9d-a3cc-09b1dc93ffaa None admin] RBAC: Adding query filter params (name=placement) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:30:13.174883 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2c754-f7ee-4d9d-a3cc-09b1dc93ffaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:13.176249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2c754-f7ee-4d9d-a3cc-09b1dc93ffaa None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:13.181413 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 663/1299] 10.222.0.62 () {56 vars in 1116 bytes} [Mon Aug 22 20:30:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:30:13.192292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945e3af-b399-4c28-b75d-cf1216bad35c None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:13.226335 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:13.293511 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945e3af-b399-4c28-b75d-cf1216bad35c None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:13.329643 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3570232-3f34-47dc-ab75-3b9836a73b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:13.330206 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3570232-3f34-47dc-ab75-3b9836a73b10 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:13.330483 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3570232-3f34-47dc-ab75-3b9836a73b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:13.330753 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3570232-3f34-47dc-ab75-3b9836a73b10 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:13.331495 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3570232-3f34-47dc-ab75-3b9836a73b10 None admin] RBAC: Adding query filter params (interface=public, service_id=de3f15d87d714bb5b8ec93535384a418, region_id=RegionOne) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:30:13.331800 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3570232-3f34-47dc-ab75-3b9836a73b10 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:13.333218 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3570232-3f34-47dc-ab75-3b9836a73b10 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:13.338506 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 637/1300] 10.222.0.62 () {56 vars in 1251 bytes} [Mon Aug 22 20:30:13 2022] GET /identity/v3/endpoints?service_id=de3f15d87d714bb5b8ec93535384a418&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:30:13.344526 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2c754-f7ee-4d9d-a3cc-09b1dc93ffaa None admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:13.429089 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:13.446998 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2c754-f7ee-4d9d-a3cc-09b1dc93ffaa None admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:13.481792 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501fe59c-15e5-47bc-870e-8bf378cc9716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:13.482664 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fe59c-15e5-47bc-870e-8bf378cc9716 None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:13.482945 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fe59c-15e5-47bc-870e-8bf378cc9716 None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:13.483216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501fe59c-15e5-47bc-870e-8bf378cc9716 None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:13.483812 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501fe59c-15e5-47bc-870e-8bf378cc9716 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:13.485225 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501fe59c-15e5-47bc-870e-8bf378cc9716 None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:13.491838 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 664/1301] 10.222.0.62 () {56 vars in 1087 bytes} [Mon Aug 22 20:30:13 2022] GET /identity/v3/services => generated 2191 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:30:15.409938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013eae9d-0531-4205-abd7-a65c10265da6 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:15.452231 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013eae9d-0531-4205-abd7-a65c10265da6 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:15.452231 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013eae9d-0531-4205-abd7-a65c10265da6 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:15.452231 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 638/1302] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:30:15.452555 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c56095-d007-4a49-b9d2-b45129c25ab1 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:15.452555 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c56095-d007-4a49-b9d2-b45129c25ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:15.452555 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c56095-d007-4a49-b9d2-b45129c25ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:15.452555 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-c1c56095-d007-4a49-b9d2-b45129c25ab1 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:30:15.452555 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-c1c56095-d007-4a49-b9d2-b45129c25ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:30:15.504873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 665/1303] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:30:15 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 20:30:15.772612 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013eae9d-0531-4205-abd7-a65c10265da6 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:15.870135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:15.877206 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013eae9d-0531-4205-abd7-a65c10265da6 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:15.910114 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf0f5e-6318-4daf-a064-b3b50f074ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:15.910735 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf0f5e-6318-4daf-a064-b3b50f074ff5 None admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:15.911011 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf0f5e-6318-4daf-a064-b3b50f074ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:15.911282 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf0f5e-6318-4daf-a064-b3b50f074ff5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:15.911855 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf0f5e-6318-4daf-a064-b3b50f074ff5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:15.913263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf0f5e-6318-4daf-a064-b3b50f074ff5 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:15.922998 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application [None req-edaf0f5e-6318-4daf-a064-b3b50f074ff5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 20:30:15.922998 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:30:15.922998 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 20:30:15.922998 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 20:30:15.922998 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 20:30:15.922998 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 20:30:15.922998 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 20:30:15.922998 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:30:15.922998 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 20:30:15.922998 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:30:15.922998 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 20:30:15.922998 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:30:15.922998 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 20:30:15.922998 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 20:30:15.922998 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 20:30:15.922998 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 20:30:15.922998 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 20:30:15.924289 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 20:30:15.924289 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 20:30:15.924289 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 20:30:15.924289 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 20:30:15.924289 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 20:30:15.924289 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 20:30:15.924289 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 20:30:15.924289 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 20:30:15.924289 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 20:30:15.924289 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 20:30:15.924289 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 20:30:15.924289 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 20:30:15.924289 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 20:30:15.924289 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 20:30:15.924289 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 20:30:15.924289 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 20:30:15.925441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 20:30:15.925441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application with Lock( Aug 22 20:30:15.925441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 20:30:15.925441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self._enter() Aug 22 20:30:15.925441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 20:30:15.925441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 20:30:15.925441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 20:30:15.925441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application return self.creator() Aug 22 20:30:15.925441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 20:30:15.925441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application created_value = creator( Aug 22 20:30:15.925441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 20:30:15.925441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 20:30:15.925441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 20:30:15.925441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: ERROR keystone.server.flask.application Aug 22 20:30:15.928803 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 639/1304] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Aug 22 20:30:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 20:30:15.930253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c56095-d007-4a49-b9d2-b45129c25ab1 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:16.008536 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:16.032634 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c56095-d007-4a49-b9d2-b45129c25ab1 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:16.067205 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855488bc-8de3-457e-b77d-f911db12ec2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:16.067807 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855488bc-8de3-457e-b77d-f911db12ec2f None admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:16.068082 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855488bc-8de3-457e-b77d-f911db12ec2f None admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:16.068348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855488bc-8de3-457e-b77d-f911db12ec2f None admin] PATH_INFO: `/v3/services` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:16.069002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855488bc-8de3-457e-b77d-f911db12ec2f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:30:16.069298 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855488bc-8de3-457e-b77d-f911db12ec2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:16.070757 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855488bc-8de3-457e-b77d-f911db12ec2f None admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:16.076426 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 666/1305] 10.222.0.62 () {56 vars in 1116 bytes} [Mon Aug 22 20:30:15 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:30:16.117872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf0f5e-6318-4daf-a064-b3b50f074ff5 None admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:30:16.193201 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf0f5e-6318-4daf-a064-b3b50f074ff5 None admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:30:16.226469 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fb798-23c1-4c39-8593-154e9b8774e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:30:16.227070 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fb798-23c1-4c39-8593-154e9b8774e8 None admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:30:16.227367 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fb798-23c1-4c39-8593-154e9b8774e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:30:16.227620 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fb798-23c1-4c39-8593-154e9b8774e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:30:16.228266 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fb798-23c1-4c39-8593-154e9b8774e8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:30:16.229679 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fb798-23c1-4c39-8593-154e9b8774e8 None admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:30:16.307476 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 640/1306] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 22 20:30:16 2022] POST /identity/v3/endpoints => generated 331 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:30:26.081931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=30 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:30:26.302973 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:36:41.778417 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc650d-f30e-47e8-ae96-49fcd12fda03 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:36:41.785692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc650d-f30e-47e8-ae96-49fcd12fda03 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:36:41.785692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc650d-f30e-47e8-ae96-49fcd12fda03 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:36:41.785692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 667/1307] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:36:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:36:41.790227 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80c571-1ad7-473b-a7b8-95ae28223ba0 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:36:41.792712 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80c571-1ad7-473b-a7b8-95ae28223ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:36:41.800789 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80c571-1ad7-473b-a7b8-95ae28223ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:36:41.906816 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-3b80c571-1ad7-473b-a7b8-95ae28223ba0 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:36:41.908349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3b80c571-1ad7-473b-a7b8-95ae28223ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:36:42.025253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 641/1308] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:36:42.330641 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84710d3f-c5f3-4c97-826e-308633aa1b83 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:36:42.330988 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84710d3f-c5f3-4c97-826e-308633aa1b83 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:36:42.331199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84710d3f-c5f3-4c97-826e-308633aa1b83 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:36:42.332601 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 668/1309] 10.222.0.62 () {54 vars in 965 bytes} [Mon Aug 22 20:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:36:42.339170 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586a6e0-c6f9-4ca4-bb1d-e1ac81cd978b None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:36:42.339544 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586a6e0-c6f9-4ca4-bb1d-e1ac81cd978b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:36:42.340039 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586a6e0-c6f9-4ca4-bb1d-e1ac81cd978b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:36:42.426366 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-8586a6e0-c6f9-4ca4-bb1d-e1ac81cd978b None None] MFA Rules not processed for user `538ba8188ed540628242c983ebd6dd1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:36:42.427584 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8586a6e0-c6f9-4ca4-bb1d-e1ac81cd978b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:36:42.449408 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:36:42.510817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 642/1310] 10.222.0.62 () {58 vars in 1062 bytes} [Mon Aug 22 20:36:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:36:42.520887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84710d3f-c5f3-4c97-826e-308633aa1b83 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:36:42.522869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-84710d3f-c5f3-4c97-826e-308633aa1b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:36:42.655819 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84710d3f-c5f3-4c97-826e-308633aa1b83 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:36:42.742199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11474c0-9d21-43d8-9dcf-fd92a840d555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:36:42.742810 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11474c0-9d21-43d8-9dcf-fd92a840d555 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:36:42.743089 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11474c0-9d21-43d8-9dcf-fd92a840d555 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:36:42.743360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11474c0-9d21-43d8-9dcf-fd92a840d555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:36:42.745016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-a11474c0-9d21-43d8-9dcf-fd92a840d555 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:36:42.805600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:36:42.861930 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11474c0-9d21-43d8-9dcf-fd92a840d555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:36:42.863550 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11474c0-9d21-43d8-9dcf-fd92a840d555 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:36:42.884125 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 669/1311] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:36:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:36:45.091057 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d77fa6-91e2-408d-a0cc-51183896d609 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:36:45.091570 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d77fa6-91e2-408d-a0cc-51183896d609 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:36:45.091689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d77fa6-91e2-408d-a0cc-51183896d609 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:36:45.094114 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 643/1312] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:36:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:36:45.099374 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b5383-e257-4de9-b2cd-820c374e019d None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:36:45.099764 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b5383-e257-4de9-b2cd-820c374e019d None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:36:45.099955 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b5383-e257-4de9-b2cd-820c374e019d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:36:45.184774 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-6a7b5383-e257-4de9-b2cd-820c374e019d None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:36:45.186568 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-6a7b5383-e257-4de9-b2cd-820c374e019d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:36:45.284621 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 670/1313] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:36:45.574065 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d77fa6-91e2-408d-a0cc-51183896d609 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:36:45.575664 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-45d77fa6-91e2-408d-a0cc-51183896d609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:36:45.677247 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d77fa6-91e2-408d-a0cc-51183896d609 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:36:45.746173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:36:45.749244 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339dae50-ab7a-4a58-a67d-35b16d67adf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:36:45.749977 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339dae50-ab7a-4a58-a67d-35b16d67adf7 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:36:45.750255 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339dae50-ab7a-4a58-a67d-35b16d67adf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:36:45.750526 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339dae50-ab7a-4a58-a67d-35b16d67adf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:36:45.752121 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-339dae50-ab7a-4a58-a67d-35b16d67adf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:36:45.861689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339dae50-ab7a-4a58-a67d-35b16d67adf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:36:45.863297 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339dae50-ab7a-4a58-a67d-35b16d67adf7 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:36:45.881557 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 644/1314] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:36:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:36:48.330389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671955b-bfc0-4c62-9d21-c8704fec2c02 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:36:48.330923 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671955b-bfc0-4c62-9d21-c8704fec2c02 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:36:48.330923 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671955b-bfc0-4c62-9d21-c8704fec2c02 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:36:48.332275 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 671/1315] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:36:48.337524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbb4ee-bdf4-46d1-a5f4-7453c6207f32 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:36:48.337913 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbb4ee-bdf4-46d1-a5f4-7453c6207f32 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:36:48.338071 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbb4ee-bdf4-46d1-a5f4-7453c6207f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:36:48.403418 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-e6dbb4ee-bdf4-46d1-a5f4-7453c6207f32 None None] MFA Rules not processed for user `380073b53b464cf9968503ff9be682ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:36:48.404730 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e6dbb4ee-bdf4-46d1-a5f4-7453c6207f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:36:48.455419 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:36:48.499409 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 645/1316] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:36:48 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:36:48.793118 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671955b-bfc0-4c62-9d21-c8704fec2c02 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:36:48.794761 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-2671955b-bfc0-4c62-9d21-c8704fec2c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:36:48.805400 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:36:48.899813 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671955b-bfc0-4c62-9d21-c8704fec2c02 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:36:48.974100 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51ff091-2818-487d-830e-7344b07c125f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:36:48.974702 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ff091-2818-487d-830e-7344b07c125f service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:36:48.974980 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ff091-2818-487d-830e-7344b07c125f service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:36:48.975249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51ff091-2818-487d-830e-7344b07c125f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:36:48.976863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-a51ff091-2818-487d-830e-7344b07c125f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:36:49.037954 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:36:49.084316 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ff091-2818-487d-830e-7344b07c125f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:36:49.085810 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51ff091-2818-487d-830e-7344b07c125f service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:36:49.104090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 672/1317] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:36:48 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:36:51.798257 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc58df0-5471-48a6-a167-0768094e5612 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:36:51.798710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc58df0-5471-48a6-a167-0768094e5612 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:36:51.798828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc58df0-5471-48a6-a167-0768094e5612 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:36:51.800154 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 646/1318] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:36:51.805582 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb327d0-4cc8-4134-ad45-fc31a5e5a692 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:36:51.805996 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb327d0-4cc8-4134-ad45-fc31a5e5a692 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:36:51.806130 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb327d0-4cc8-4134-ad45-fc31a5e5a692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:36:51.871078 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-5fb327d0-4cc8-4134-ad45-fc31a5e5a692 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:36:51.872310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-5fb327d0-4cc8-4134-ad45-fc31a5e5a692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:36:51.967935 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 673/1319] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:36:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:36:52.251002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc58df0-5471-48a6-a167-0768094e5612 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:36:52.252561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-abc58df0-5471-48a6-a167-0768094e5612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:36:52.354544 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc58df0-5471-48a6-a167-0768094e5612 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:36:52.426997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47c943-11bc-4700-a9ff-4657a5dde145 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:36:52.427596 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47c943-11bc-4700-a9ff-4657a5dde145 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:36:52.427875 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47c943-11bc-4700-a9ff-4657a5dde145 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:36:52.428145 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47c943-11bc-4700-a9ff-4657a5dde145 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:36:52.429772 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7a47c943-11bc-4700-a9ff-4657a5dde145 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:36:52.437347 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:36:52.537759 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47c943-11bc-4700-a9ff-4657a5dde145 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:36:52.539120 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47c943-11bc-4700-a9ff-4657a5dde145 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:36:52.556990 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 647/1320] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:36:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:36:55.450610 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df573438-f844-456e-aa4b-7d891090a931 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:36:55.451682 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df573438-f844-456e-aa4b-7d891090a931 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:36:55.451862 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df573438-f844-456e-aa4b-7d891090a931 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:36:55.453123 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 674/1321] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:36:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:36:55.458451 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5332a37-10d3-4d47-a51a-1a2857efcd86 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:36:55.458858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5332a37-10d3-4d47-a51a-1a2857efcd86 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:36:55.459008 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5332a37-10d3-4d47-a51a-1a2857efcd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:36:55.526775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-e5332a37-10d3-4d47-a51a-1a2857efcd86 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:36:55.527995 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e5332a37-10d3-4d47-a51a-1a2857efcd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:36:55.588182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:36:55.628739 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 648/1322] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:36:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:36:55.925664 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b3e8c-6af1-44ca-8ce4-d8839f897078 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:36:55.926032 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b3e8c-6af1-44ca-8ce4-d8839f897078 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:36:55.926370 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b3e8c-6af1-44ca-8ce4-d8839f897078 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:36:55.927762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 675/1323] 10.222.0.62 () {54 vars in 965 bytes} [Mon Aug 22 20:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:36:55.933777 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e373bfd-8131-4bfd-a36a-d167746c4f2d None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:36:55.934124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e373bfd-8131-4bfd-a36a-d167746c4f2d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:36:55.934461 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e373bfd-8131-4bfd-a36a-d167746c4f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:36:56.010881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-8e373bfd-8131-4bfd-a36a-d167746c4f2d None None] MFA Rules not processed for user `538ba8188ed540628242c983ebd6dd1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:36:56.012094 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8e373bfd-8131-4bfd-a36a-d167746c4f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:36:56.089162 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 649/1324] 10.222.0.62 () {58 vars in 1062 bytes} [Mon Aug 22 20:36:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:36:56.098965 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b3e8c-6af1-44ca-8ce4-d8839f897078 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:36:56.100594 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-699b3e8c-6af1-44ca-8ce4-d8839f897078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:36:56.120302 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:36:56.207128 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b3e8c-6af1-44ca-8ce4-d8839f897078 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:36:56.279808 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afcadc6-0b86-4800-8a73-0c8e525250fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:36:56.280468 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcadc6-0b86-4800-8a73-0c8e525250fb service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:36:56.280777 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcadc6-0b86-4800-8a73-0c8e525250fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:36:56.281045 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcadc6-0b86-4800-8a73-0c8e525250fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:36:56.282637 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-3afcadc6-0b86-4800-8a73-0c8e525250fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:36:56.352874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:36:56.391296 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afcadc6-0b86-4800-8a73-0c8e525250fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:36:56.392836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afcadc6-0b86-4800-8a73-0c8e525250fb service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:36:56.411225 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 676/1325] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:36:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:36:58.623689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8eef7a-662e-4532-b41d-71c06002ebdc None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:36:58.624292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8eef7a-662e-4532-b41d-71c06002ebdc None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:36:58.624292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8eef7a-662e-4532-b41d-71c06002ebdc None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:36:58.625607 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 650/1326] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:36:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:36:58.631096 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e542d-b5fd-48ce-a711-457763641e2b None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:36:58.631539 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e542d-b5fd-48ce-a711-457763641e2b None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:36:58.631642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e542d-b5fd-48ce-a711-457763641e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:36:58.699224 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-ef3e542d-b5fd-48ce-a711-457763641e2b None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:36:58.700437 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-ef3e542d-b5fd-48ce-a711-457763641e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:36:58.804716 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 677/1327] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:36:59.087857 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8eef7a-662e-4532-b41d-71c06002ebdc None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:36:59.089501 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9a8eef7a-662e-4532-b41d-71c06002ebdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:36:59.150329 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:36:59.195425 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8eef7a-662e-4532-b41d-71c06002ebdc None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:36:59.269331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff318933-752c-46ac-a0e8-2e0651419d5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:36:59.270060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff318933-752c-46ac-a0e8-2e0651419d5d service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:36:59.270416 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff318933-752c-46ac-a0e8-2e0651419d5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:36:59.270756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff318933-752c-46ac-a0e8-2e0651419d5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:36:59.272401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ff318933-752c-46ac-a0e8-2e0651419d5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:36:59.382654 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:36:59.384945 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff318933-752c-46ac-a0e8-2e0651419d5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:36:59.386395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff318933-752c-46ac-a0e8-2e0651419d5d service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:36:59.404802 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 651/1328] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:36:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:37:01.388471 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a0b21-e138-4415-aa8c-43021050e5de None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:01.388959 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a0b21-e138-4415-aa8c-43021050e5de None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:01.389047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a0b21-e138-4415-aa8c-43021050e5de None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:01.390656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 678/1329] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:37:01.397234 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829d400-b9ed-42a4-9c96-45ef2dcfa7bb None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:01.397697 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829d400-b9ed-42a4-9c96-45ef2dcfa7bb None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:01.398313 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829d400-b9ed-42a4-9c96-45ef2dcfa7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:01.486251 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-2829d400-b9ed-42a4-9c96-45ef2dcfa7bb None None] MFA Rules not processed for user `380073b53b464cf9968503ff9be682ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:37:01.487389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2829d400-b9ed-42a4-9c96-45ef2dcfa7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:01.588067 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 652/1330] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:37:01 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:37:01.875734 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a0b21-e138-4415-aa8c-43021050e5de None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:37:01.877406 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-1a9a0b21-e138-4415-aa8c-43021050e5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:01.909568 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:37:01.992364 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a0b21-e138-4415-aa8c-43021050e5de None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:37:02.072888 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7be444-a0f5-49ea-a5db-61f294c96756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:37:02.073492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7be444-a0f5-49ea-a5db-61f294c96756 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:02.073766 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7be444-a0f5-49ea-a5db-61f294c96756 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:02.074034 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7be444-a0f5-49ea-a5db-61f294c96756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:02.076318 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-4b7be444-a0f5-49ea-a5db-61f294c96756 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:02.157936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:37:02.191789 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7be444-a0f5-49ea-a5db-61f294c96756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:37:02.193277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7be444-a0f5-49ea-a5db-61f294c96756 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:37:02.213696 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 679/1331] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:37:01 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:37:04.836898 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad473f-b996-46f3-9849-28a8f7976931 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:04.837427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad473f-b996-46f3-9849-28a8f7976931 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:04.837427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad473f-b996-46f3-9849-28a8f7976931 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:04.838759 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 653/1332] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:37:04.845131 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e34fda-1044-47b8-93d9-b89e7e8dd848 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:04.845550 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e34fda-1044-47b8-93d9-b89e7e8dd848 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:04.845719 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e34fda-1044-47b8-93d9-b89e7e8dd848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:04.912347 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-b4e34fda-1044-47b8-93d9-b89e7e8dd848 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:37:04.913573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b4e34fda-1044-47b8-93d9-b89e7e8dd848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:05.008594 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 680/1333] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:37:05.294247 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad473f-b996-46f3-9849-28a8f7976931 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:37:05.295966 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-72ad473f-b996-46f3-9849-28a8f7976931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:05.364958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:37:05.398881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad473f-b996-46f3-9849-28a8f7976931 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:37:05.473005 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e1b21-7db8-45ee-a6b8-aca372c2f03c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:37:05.473606 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e1b21-7db8-45ee-a6b8-aca372c2f03c service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:05.473882 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e1b21-7db8-45ee-a6b8-aca372c2f03c service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:05.474151 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e1b21-7db8-45ee-a6b8-aca372c2f03c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:05.475782 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-865e1b21-7db8-45ee-a6b8-aca372c2f03c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:05.585756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e1b21-7db8-45ee-a6b8-aca372c2f03c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:37:05.587109 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e1b21-7db8-45ee-a6b8-aca372c2f03c service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:37:05.597338 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:37:05.605124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 654/1334] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:37:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:37:07.599601 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c054eb-3f52-4356-85b6-de8e313b9494 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:07.600115 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c054eb-3f52-4356-85b6-de8e313b9494 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:07.600115 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c054eb-3f52-4356-85b6-de8e313b9494 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:07.601470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 681/1335] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:37:07.607274 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f568f-56f3-44ac-b2ff-16de95c8bc8e None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:07.607796 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f568f-56f3-44ac-b2ff-16de95c8bc8e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:07.608107 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f568f-56f3-44ac-b2ff-16de95c8bc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:07.674102 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-1c1f568f-56f3-44ac-b2ff-16de95c8bc8e None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:37:07.675319 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1c1f568f-56f3-44ac-b2ff-16de95c8bc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:07.771006 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 655/1336] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:37:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:37:08.059253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c054eb-3f52-4356-85b6-de8e313b9494 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:37:08.061139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-08c054eb-3f52-4356-85b6-de8e313b9494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:08.102403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:37:08.165094 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c054eb-3f52-4356-85b6-de8e313b9494 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:37:08.237595 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91510e9d-80cd-4196-b52f-9154297746ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:37:08.238189 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91510e9d-80cd-4196-b52f-9154297746ff service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:08.238464 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91510e9d-80cd-4196-b52f-9154297746ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:08.238731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91510e9d-80cd-4196-b52f-9154297746ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:08.240340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-91510e9d-80cd-4196-b52f-9154297746ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:08.321881 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:37:08.347064 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91510e9d-80cd-4196-b52f-9154297746ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:37:08.348819 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91510e9d-80cd-4196-b52f-9154297746ff service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:37:08.366965 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 682/1337] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:37:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:37:10.888818 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22dc4e5-9541-4e09-9231-9800c8f51fae None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:10.889349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22dc4e5-9541-4e09-9231-9800c8f51fae None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:10.889349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22dc4e5-9541-4e09-9231-9800c8f51fae None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:10.890707 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 656/1338] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:37:10.895851 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95015b-12c1-4eb3-a963-742a3cec5046 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:10.896302 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95015b-12c1-4eb3-a963-742a3cec5046 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:10.896406 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95015b-12c1-4eb3-a963-742a3cec5046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:10.962638 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-0a95015b-12c1-4eb3-a963-742a3cec5046 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:37:10.963842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-0a95015b-12c1-4eb3-a963-742a3cec5046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:11.062012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 683/1339] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:37:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:37:11.343595 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22dc4e5-9541-4e09-9231-9800c8f51fae None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:37:11.345198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a22dc4e5-9541-4e09-9231-9800c8f51fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:11.421703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:37:11.449369 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22dc4e5-9541-4e09-9231-9800c8f51fae None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:37:11.521735 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5486a9-ae0b-4fab-8505-6153e6b71544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:37:11.522335 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5486a9-ae0b-4fab-8505-6153e6b71544 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:11.522614 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5486a9-ae0b-4fab-8505-6153e6b71544 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:11.522885 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5486a9-ae0b-4fab-8505-6153e6b71544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:11.524481 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4c5486a9-ae0b-4fab-8505-6153e6b71544 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:11.631602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5486a9-ae0b-4fab-8505-6153e6b71544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:37:11.633042 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5486a9-ae0b-4fab-8505-6153e6b71544 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:37:11.652717 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 657/1340] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:37:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:37:15.840293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dab6c2-0dbd-4d0e-96fe-ede2a54bac86 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:15.840844 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dab6c2-0dbd-4d0e-96fe-ede2a54bac86 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:15.841479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dab6c2-0dbd-4d0e-96fe-ede2a54bac86 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:15.842840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 684/1341] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:37:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:37:15.848285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c1a60-7109-4aee-8d74-35b758db3daf None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:15.848732 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c1a60-7109-4aee-8d74-35b758db3daf None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:15.849008 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c1a60-7109-4aee-8d74-35b758db3daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:15.854569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:37:15.917127 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-343c1a60-7109-4aee-8d74-35b758db3daf None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:37:15.918389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-343c1a60-7109-4aee-8d74-35b758db3daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:16.018554 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 658/1342] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:37:16.301607 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dab6c2-0dbd-4d0e-96fe-ede2a54bac86 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:37:16.303238 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-a4dab6c2-0dbd-4d0e-96fe-ede2a54bac86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:16.352092 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:37:16.408332 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dab6c2-0dbd-4d0e-96fe-ede2a54bac86 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:37:16.481851 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127bba1-b149-4ef7-9c42-9e83d3f3a44c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:37:16.482457 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127bba1-b149-4ef7-9c42-9e83d3f3a44c service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:16.482737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127bba1-b149-4ef7-9c42-9e83d3f3a44c service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:16.483011 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127bba1-b149-4ef7-9c42-9e83d3f3a44c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:16.484631 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-f127bba1-b149-4ef7-9c42-9e83d3f3a44c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:16.579397 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:37:16.600541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127bba1-b149-4ef7-9c42-9e83d3f3a44c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:37:16.602020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127bba1-b149-4ef7-9c42-9e83d3f3a44c service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:37:16.620990 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 685/1343] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:37:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:37:19.565066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c150a-d845-4d1d-9668-e3744dae38e9 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:19.565588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c150a-d845-4d1d-9668-e3744dae38e9 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:19.565588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c150a-d845-4d1d-9668-e3744dae38e9 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:19.566871 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 659/1344] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:37:19.572119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a0596-45e0-4fa0-a595-d826907b0a38 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:19.572560 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a0596-45e0-4fa0-a595-d826907b0a38 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:19.572888 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a0596-45e0-4fa0-a595-d826907b0a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:19.643190 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-2e2a0596-45e0-4fa0-a595-d826907b0a38 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:37:19.644423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-2e2a0596-45e0-4fa0-a595-d826907b0a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:19.743162 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 686/1345] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:37:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:37:20.034308 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c150a-d845-4d1d-9668-e3744dae38e9 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:37:20.035941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-938c150a-d845-4d1d-9668-e3744dae38e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:20.128247 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:37:20.144725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c150a-d845-4d1d-9668-e3744dae38e9 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:37:20.220731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e90bae-7678-49ac-a76c-522b267e9de7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:37:20.221345 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e90bae-7678-49ac-a76c-522b267e9de7 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:20.221626 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e90bae-7678-49ac-a76c-522b267e9de7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:20.221898 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e90bae-7678-49ac-a76c-522b267e9de7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:20.223504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a4e90bae-7678-49ac-a76c-522b267e9de7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:20.338750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e90bae-7678-49ac-a76c-522b267e9de7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:37:20.340236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e90bae-7678-49ac-a76c-522b267e9de7 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:37:20.361995 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 660/1346] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:37:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:37:24.860399 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59626261-a0a3-4da9-b19d-d14a93931d18 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:24.860960 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59626261-a0a3-4da9-b19d-d14a93931d18 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:24.860960 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59626261-a0a3-4da9-b19d-d14a93931d18 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:24.862326 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 687/1347] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:37:24.868023 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa7f46-3638-4add-9e9a-abf290fdf8e2 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:24.868546 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa7f46-3638-4add-9e9a-abf290fdf8e2 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:24.868644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa7f46-3638-4add-9e9a-abf290fdf8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:24.886072 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:37:24.942368 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-a7aa7f46-3638-4add-9e9a-abf290fdf8e2 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:37:24.943607 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a7aa7f46-3638-4add-9e9a-abf290fdf8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:25.045898 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 661/1348] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:37:25.336851 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59626261-a0a3-4da9-b19d-d14a93931d18 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:37:25.338426 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-59626261-a0a3-4da9-b19d-d14a93931d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:25.406827 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:37:25.457622 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59626261-a0a3-4da9-b19d-d14a93931d18 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:37:25.534770 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ac705-d43d-4025-b6ed-60668bd3fc85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:37:25.535379 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ac705-d43d-4025-b6ed-60668bd3fc85 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:25.535680 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ac705-d43d-4025-b6ed-60668bd3fc85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:25.535953 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ac705-d43d-4025-b6ed-60668bd3fc85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:25.537625 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-610ac705-d43d-4025-b6ed-60668bd3fc85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:25.646662 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:37:25.650428 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ac705-d43d-4025-b6ed-60668bd3fc85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:37:25.651872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ac705-d43d-4025-b6ed-60668bd3fc85 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:37:25.671558 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 688/1349] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:37:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:37:30.590168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29ea87-a177-4ef7-95fd-cfbb4929a37c None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:30.590762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29ea87-a177-4ef7-95fd-cfbb4929a37c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:30.590762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29ea87-a177-4ef7-95fd-cfbb4929a37c None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:30.592314 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 662/1350] 10.222.0.62 () {54 vars in 921 bytes} [Mon Aug 22 20:37:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:37:30.597543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841d325-73da-405b-8163-5d0fe782099c None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:30.598412 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841d325-73da-405b-8163-5d0fe782099c None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:30.598901 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841d325-73da-405b-8163-5d0fe782099c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:30.703593 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-2841d325-73da-405b-8163-5d0fe782099c None None] MFA Rules not processed for user `d3fdb2336b8b4f7c9b710b224a8594a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:37:30.704868 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-2841d325-73da-405b-8163-5d0fe782099c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:30.856577 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 689/1351] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Aug 22 20:37:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:37:35.043860 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=59 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:37:35.230520 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6712d1-1d8c-455b-9bc3-5aca603b4ca3 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:35.230814 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6712d1-1d8c-455b-9bc3-5aca603b4ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:35.231039 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6712d1-1d8c-455b-9bc3-5aca603b4ca3 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:35.232376 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 663/1352] 10.222.0.62 () {54 vars in 921 bytes} [Mon Aug 22 20:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:37:35.237523 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce352ca-ac48-4506-85fe-d6ac70911ed2 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:35.238371 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce352ca-ac48-4506-85fe-d6ac70911ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:35.238880 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce352ca-ac48-4506-85fe-d6ac70911ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:35.298326 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:37:35.325044 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-3ce352ca-ac48-4506-85fe-d6ac70911ed2 None None] MFA Rules not processed for user `d3fdb2336b8b4f7c9b710b224a8594a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:37:35.326676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-3ce352ca-ac48-4506-85fe-d6ac70911ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:35.458768 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 690/1353] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Aug 22 20:37:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:37:36.808312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bf9bc-6187-47c1-bd95-6ae1780b5b74 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:36.809136 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bf9bc-6187-47c1-bd95-6ae1780b5b74 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:36.809396 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bf9bc-6187-47c1-bd95-6ae1780b5b74 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:36.810834 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 664/1354] 10.222.0.62 () {54 vars in 921 bytes} [Mon Aug 22 20:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:37:36.815944 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40576f32-72f1-457e-b2d5-7ba78af74162 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:36.816345 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40576f32-72f1-457e-b2d5-7ba78af74162 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:36.816618 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40576f32-72f1-457e-b2d5-7ba78af74162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:36.893754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-40576f32-72f1-457e-b2d5-7ba78af74162 None None] MFA Rules not processed for user `d3fdb2336b8b4f7c9b710b224a8594a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:37:36.894958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-40576f32-72f1-457e-b2d5-7ba78af74162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:36.937532 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:37:37.005372 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 691/1355] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Aug 22 20:37:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:37:40.243182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d51cf-a52e-414c-86af-819027d199d3 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:40.243732 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d51cf-a52e-414c-86af-819027d199d3 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:40.243732 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939d51cf-a52e-414c-86af-819027d199d3 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:40.245159 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 665/1356] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:37:40.250526 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b1181-6e46-4475-8531-4565da59fb27 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:40.250956 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b1181-6e46-4475-8531-4565da59fb27 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:40.251105 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b1181-6e46-4475-8531-4565da59fb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:40.333939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-1c7b1181-6e46-4475-8531-4565da59fb27 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:37:40.335117 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-1c7b1181-6e46-4475-8531-4565da59fb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:40.465356 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 692/1357] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:37:40.773793 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d71f8-10ea-4534-a94b-e43f5265a911 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:40.774848 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d71f8-10ea-4534-a94b-e43f5265a911 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:40.774848 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d71f8-10ea-4534-a94b-e43f5265a911 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:40.776557 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 666/1358] 10.222.0.62 () {54 vars in 962 bytes} [Mon Aug 22 20:37:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:37:40.787207 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c58cc2-d48f-42a4-9a3f-0b3562184577 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:40.788045 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c58cc2-d48f-42a4-9a3f-0b3562184577 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:40.788530 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c58cc2-d48f-42a4-9a3f-0b3562184577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:40.811349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:37:40.884313 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-85c58cc2-d48f-42a4-9a3f-0b3562184577 None None] MFA Rules not processed for user `9f1738f72b4848499cdf0ec6866c3c8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:37:40.886934 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-85c58cc2-d48f-42a4-9a3f-0b3562184577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:41.012823 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 693/1359] 10.222.0.62 () {58 vars in 1059 bytes} [Mon Aug 22 20:37:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:37:41.020744 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d71f8-10ea-4534-a94b-e43f5265a911 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:37:41.022548 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-355d71f8-10ea-4534-a94b-e43f5265a911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:41.193337 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d71f8-10ea-4534-a94b-e43f5265a911 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:37:41.271708 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:37:41.318772 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687821dd-0243-4c93-8256-d33e1b0f78f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1738f72b4848499cdf0ec6866c3c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:37:41.319417 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687821dd-0243-4c93-8256-d33e1b0f78f7 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:41.319856 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687821dd-0243-4c93-8256-d33e1b0f78f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:41.320135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687821dd-0243-4c93-8256-d33e1b0f78f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:41.321861 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-687821dd-0243-4c93-8256-d33e1b0f78f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:41.420370 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687821dd-0243-4c93-8256-d33e1b0f78f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:37:41.422018 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687821dd-0243-4c93-8256-d33e1b0f78f7 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:37:41.441729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 667/1360] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:37:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:37:43.580274 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131c79b-b5bf-45a6-b224-44abc28af557 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:43.580907 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131c79b-b5bf-45a6-b224-44abc28af557 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:43.581010 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131c79b-b5bf-45a6-b224-44abc28af557 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:43.584728 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 694/1361] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:37:43.588575 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e42e7-7356-408e-8479-55abb676ebfd None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:43.589110 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e42e7-7356-408e-8479-55abb676ebfd None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:43.589805 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e42e7-7356-408e-8479-55abb676ebfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:43.663457 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-ed0e42e7-7356-408e-8479-55abb676ebfd None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:37:43.664731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-ed0e42e7-7356-408e-8479-55abb676ebfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:43.707863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:37:43.773095 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 668/1362] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:37:44.074400 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131c79b-b5bf-45a6-b224-44abc28af557 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:37:44.075917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b131c79b-b5bf-45a6-b224-44abc28af557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:44.176338 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:37:44.264590 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131c79b-b5bf-45a6-b224-44abc28af557 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:37:44.384207 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4084c12-69a0-4a5e-a8f5-37c35260b945 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1738f72b4848499cdf0ec6866c3c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:37:44.384836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4084c12-69a0-4a5e-a8f5-37c35260b945 service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:44.385113 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4084c12-69a0-4a5e-a8f5-37c35260b945 service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:44.385381 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4084c12-69a0-4a5e-a8f5-37c35260b945 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:44.387032 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-c4084c12-69a0-4a5e-a8f5-37c35260b945 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:44.411396 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:37:44.483393 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4084c12-69a0-4a5e-a8f5-37c35260b945 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:37:44.485105 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4084c12-69a0-4a5e-a8f5-37c35260b945 service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:37:44.507568 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 695/1363] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:37:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:37:46.898002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c305073-a936-40c9-940c-3269055c6dcf None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:46.898575 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c305073-a936-40c9-940c-3269055c6dcf None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:46.898658 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c305073-a936-40c9-940c-3269055c6dcf None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:46.900008 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 669/1364] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:37:46.906014 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407e1b9-1cb5-4072-aa24-1aa94585c823 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:46.906767 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407e1b9-1cb5-4072-aa24-1aa94585c823 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:46.907222 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407e1b9-1cb5-4072-aa24-1aa94585c823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:47.100959 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-b407e1b9-1cb5-4072-aa24-1aa94585c823 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:37:47.102071 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b407e1b9-1cb5-4072-aa24-1aa94585c823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:47.201554 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:37:47.208710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 696/1365] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:37:47.514835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6c042-f488-445f-a85a-46beef5008b2 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:47.515297 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6c042-f488-445f-a85a-46beef5008b2 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:47.515623 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6c042-f488-445f-a85a-46beef5008b2 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:47.517002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 670/1366] 10.222.0.62 () {54 vars in 962 bytes} [Mon Aug 22 20:37:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:37:47.522838 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae7275-8497-4514-a6c7-b33ecd783a58 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:47.523355 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae7275-8497-4514-a6c7-b33ecd783a58 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:47.523704 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae7275-8497-4514-a6c7-b33ecd783a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:47.607059 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-73ae7275-8497-4514-a6c7-b33ecd783a58 None None] MFA Rules not processed for user `9f1738f72b4848499cdf0ec6866c3c8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:37:47.608279 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-73ae7275-8497-4514-a6c7-b33ecd783a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:47.736425 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 697/1367] 10.222.0.62 () {58 vars in 1059 bytes} [Mon Aug 22 20:37:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:37:47.744690 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6c042-f488-445f-a85a-46beef5008b2 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:37:47.746478 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f9c6c042-f488-445f-a85a-46beef5008b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:47.906323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6c042-f488-445f-a85a-46beef5008b2 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:37:47.926683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:37:48.031446 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c00e9-6fc8-43d0-913e-13023cc442e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1738f72b4848499cdf0ec6866c3c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:37:48.032049 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c00e9-6fc8-43d0-913e-13023cc442e8 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:48.032324 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c00e9-6fc8-43d0-913e-13023cc442e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:48.032765 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c00e9-6fc8-43d0-913e-13023cc442e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:48.034388 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-150c00e9-6fc8-43d0-913e-13023cc442e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:48.128034 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c00e9-6fc8-43d0-913e-13023cc442e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:37:48.129591 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c00e9-6fc8-43d0-913e-13023cc442e8 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:37:48.154602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 671/1368] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:37:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:37:48.553626 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cbe34-2ccc-4ab2-bd8b-3061fac07c0f None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:48.554200 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cbe34-2ccc-4ab2-bd8b-3061fac07c0f None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:48.554200 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cbe34-2ccc-4ab2-bd8b-3061fac07c0f None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:48.555649 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 698/1369] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:37:48.562516 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28e36f-597e-4d4b-9ad4-e6ac88a31c8b None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:48.562805 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28e36f-597e-4d4b-9ad4-e6ac88a31c8b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:48.563069 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28e36f-597e-4d4b-9ad4-e6ac88a31c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:48.596389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:37:48.634648 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-4a28e36f-597e-4d4b-9ad4-e6ac88a31c8b None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:37:48.635926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4a28e36f-597e-4d4b-9ad4-e6ac88a31c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:48.756888 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 672/1370] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:37:49.347341 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bdb31-7c49-4f11-b398-9395c5790515 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:49.347341 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bdb31-7c49-4f11-b398-9395c5790515 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:49.347655 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8bdb31-7c49-4f11-b398-9395c5790515 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:49.349218 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 699/1371] 10.222.0.62 () {54 vars in 964 bytes} [Mon Aug 22 20:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:37:49.354145 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807a05d-dda3-4cff-a649-047b8a8ee38b None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:49.354775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807a05d-dda3-4cff-a649-047b8a8ee38b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:49.354775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807a05d-dda3-4cff-a649-047b8a8ee38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:49.441055 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-e807a05d-dda3-4cff-a649-047b8a8ee38b None None] MFA Rules not processed for user `893e204cfff74570b3226b2e8c47df57`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:37:49.442289 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e807a05d-dda3-4cff-a649-047b8a8ee38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:49.498167 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:37:49.531007 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 673/1372] 10.222.0.62 () {58 vars in 1061 bytes} [Mon Aug 22 20:37:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:37:49.539138 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bdb31-7c49-4f11-b398-9395c5790515 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:37:49.540638 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-ea8bdb31-7c49-4f11-b398-9395c5790515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:49.594054 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:37:49.649053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8bdb31-7c49-4f11-b398-9395c5790515 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:37:49.729334 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a617a9a-dd97-4801-883a-129ab4a2228a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '893e204cfff74570b3226b2e8c47df57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:37:49.730604 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a617a9a-dd97-4801-883a-129ab4a2228a service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:49.730880 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a617a9a-dd97-4801-883a-129ab4a2228a service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:49.731236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a617a9a-dd97-4801-883a-129ab4a2228a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:49.732903 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-7a617a9a-dd97-4801-883a-129ab4a2228a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:49.859632 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:37:49.873963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a617a9a-dd97-4801-883a-129ab4a2228a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:37:49.875037 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a617a9a-dd97-4801-883a-129ab4a2228a service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:37:49.895811 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 700/1373] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:37:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:37:50.329817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418bca2-903d-439d-9e4a-9d84c1be4b16 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:50.330085 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418bca2-903d-439d-9e4a-9d84c1be4b16 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:50.330361 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418bca2-903d-439d-9e4a-9d84c1be4b16 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:50.331707 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 674/1374] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:37:50.336861 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf49bb-eee3-412e-8ed2-3062ad23650c None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:50.337141 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf49bb-eee3-412e-8ed2-3062ad23650c None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:50.337415 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf49bb-eee3-412e-8ed2-3062ad23650c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:50.404890 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-efaf49bb-eee3-412e-8ed2-3062ad23650c None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:37:50.406091 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-efaf49bb-eee3-412e-8ed2-3062ad23650c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:50.504168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 701/1375] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:37:50.803808 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418bca2-903d-439d-9e4a-9d84c1be4b16 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:37:50.805573 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1418bca2-903d-439d-9e4a-9d84c1be4b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:50.953152 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418bca2-903d-439d-9e4a-9d84c1be4b16 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:37:51.004185 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:37:51.072587 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af475b02-3ef3-44f9-849b-727fc50b1bb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1738f72b4848499cdf0ec6866c3c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:37:51.073926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af475b02-3ef3-44f9-849b-727fc50b1bb8 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:51.074202 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af475b02-3ef3-44f9-849b-727fc50b1bb8 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:51.074470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af475b02-3ef3-44f9-849b-727fc50b1bb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:51.076096 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-af475b02-3ef3-44f9-849b-727fc50b1bb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:51.171113 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af475b02-3ef3-44f9-849b-727fc50b1bb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:37:51.172813 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af475b02-3ef3-44f9-849b-727fc50b1bb8 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:37:51.191072 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 675/1376] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:37:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:37:53.266541 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed887f1-4e6a-46b2-aa82-bcbc040cfbfa None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:53.267107 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed887f1-4e6a-46b2-aa82-bcbc040cfbfa None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:53.267107 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed887f1-4e6a-46b2-aa82-bcbc040cfbfa None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:53.268436 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 702/1377] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:37:53.273630 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9132cc-603f-482c-ab27-fa98c4c32ca0 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:53.274024 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9132cc-603f-482c-ab27-fa98c4c32ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:53.274174 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9132cc-603f-482c-ab27-fa98c4c32ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:53.342274 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-9b9132cc-603f-482c-ab27-fa98c4c32ca0 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:37:53.343495 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9b9132cc-603f-482c-ab27-fa98c4c32ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:53.350197 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:37:53.446637 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 676/1378] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:37:53.756608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed887f1-4e6a-46b2-aa82-bcbc040cfbfa None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:37:53.758217 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-0ed887f1-4e6a-46b2-aa82-bcbc040cfbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:53.832604 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:37:53.922676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed887f1-4e6a-46b2-aa82-bcbc040cfbfa None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:37:54.041208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cad3d2-718c-4238-9c62-469ec50373a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1738f72b4848499cdf0ec6866c3c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:37:54.042890 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cad3d2-718c-4238-9c62-469ec50373a4 service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:54.043226 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cad3d2-718c-4238-9c62-469ec50373a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:54.043559 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cad3d2-718c-4238-9c62-469ec50373a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:54.045242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-47cad3d2-718c-4238-9c62-469ec50373a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:54.064819 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:37:54.139980 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cad3d2-718c-4238-9c62-469ec50373a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:37:54.141717 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cad3d2-718c-4238-9c62-469ec50373a4 service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:37:54.161238 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 703/1379] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:37:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:37:56.248585 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eea3b5-d968-45bc-9e36-0b5ef0da6887 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:56.249194 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eea3b5-d968-45bc-9e36-0b5ef0da6887 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:56.249194 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eea3b5-d968-45bc-9e36-0b5ef0da6887 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:56.250834 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 677/1380] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:37:56.256034 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b01138-eb4a-4365-9e22-883e41099c33 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:56.256461 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b01138-eb4a-4365-9e22-883e41099c33 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:56.256647 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b01138-eb4a-4365-9e22-883e41099c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:56.333656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-32b01138-eb4a-4365-9e22-883e41099c33 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:37:56.334860 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-32b01138-eb4a-4365-9e22-883e41099c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:56.444929 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:37:56.457123 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 704/1381] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:37:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:37:56.749506 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eea3b5-d968-45bc-9e36-0b5ef0da6887 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:37:56.751262 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-33eea3b5-d968-45bc-9e36-0b5ef0da6887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:56.905638 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:37:56.916682 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eea3b5-d968-45bc-9e36-0b5ef0da6887 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:37:57.042931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd6e27-9c3c-452a-be87-6435e2f4ecb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1738f72b4848499cdf0ec6866c3c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:37:57.043680 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd6e27-9c3c-452a-be87-6435e2f4ecb2 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:57.044032 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd6e27-9c3c-452a-be87-6435e2f4ecb2 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:57.044391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd6e27-9c3c-452a-be87-6435e2f4ecb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:57.046071 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e3dd6e27-9c3c-452a-be87-6435e2f4ecb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:57.141517 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd6e27-9c3c-452a-be87-6435e2f4ecb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:37:57.143207 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd6e27-9c3c-452a-be87-6435e2f4ecb2 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:37:57.154622 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:37:57.163782 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 678/1382] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:37:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:37:59.297579 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf929ea-75aa-4c34-b983-374e2a32e75a None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:59.298709 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf929ea-75aa-4c34-b983-374e2a32e75a None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:59.298709 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf929ea-75aa-4c34-b983-374e2a32e75a None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:59.299437 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 705/1383] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:37:59.305593 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d09a2-a049-41fc-a061-d4fcb3ce4908 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:37:59.306006 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d09a2-a049-41fc-a061-d4fcb3ce4908 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:37:59.306339 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d09a2-a049-41fc-a061-d4fcb3ce4908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:37:59.382337 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-4d6d09a2-a049-41fc-a061-d4fcb3ce4908 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:37:59.383625 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4d6d09a2-a049-41fc-a061-d4fcb3ce4908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:59.506593 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 679/1384] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:37:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:37:59.808050 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf929ea-75aa-4c34-b983-374e2a32e75a None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:37:59.809754 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-aaf929ea-75aa-4c34-b983-374e2a32e75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:37:59.958870 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf929ea-75aa-4c34-b983-374e2a32e75a None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:00.032683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:00.082320 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f6f4b-aad9-49e5-b8be-b07040477f6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1738f72b4848499cdf0ec6866c3c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:00.082973 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f6f4b-aad9-49e5-b8be-b07040477f6e service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:00.083218 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f6f4b-aad9-49e5-b8be-b07040477f6e service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:00.083493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f6f4b-aad9-49e5-b8be-b07040477f6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:00.085183 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-c85f6f4b-aad9-49e5-b8be-b07040477f6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:00.177852 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f6f4b-aad9-49e5-b8be-b07040477f6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:00.179445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f6f4b-aad9-49e5-b8be-b07040477f6e service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:00.199271 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 706/1385] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:37:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:38:02.201029 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669b32c-a2bd-4aae-a7f6-a80362364588 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:02.201605 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669b32c-a2bd-4aae-a7f6-a80362364588 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:02.201605 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669b32c-a2bd-4aae-a7f6-a80362364588 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:02.203310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 680/1386] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:02.210201 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b229f-783f-4716-b36f-7bd724502c9c None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:02.210636 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b229f-783f-4716-b36f-7bd724502c9c None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:02.211082 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b229f-783f-4716-b36f-7bd724502c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:02.302773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-406b229f-783f-4716-b36f-7bd724502c9c None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:02.304073 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-406b229f-783f-4716-b36f-7bd724502c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:02.341737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:02.411276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 707/1387] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:38:02.717343 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669b32c-a2bd-4aae-a7f6-a80362364588 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:02.718887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1669b32c-a2bd-4aae-a7f6-a80362364588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:02.803989 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:02.880034 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669b32c-a2bd-4aae-a7f6-a80362364588 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:03.000393 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675139b-6c36-46a5-ba9a-52ee66b82491 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1738f72b4848499cdf0ec6866c3c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:03.000903 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675139b-6c36-46a5-ba9a-52ee66b82491 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:03.001193 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675139b-6c36-46a5-ba9a-52ee66b82491 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:03.001519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675139b-6c36-46a5-ba9a-52ee66b82491 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:03.003058 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4675139b-6c36-46a5-ba9a-52ee66b82491 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:03.042410 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:03.096895 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4675139b-6c36-46a5-ba9a-52ee66b82491 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:03.098570 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4675139b-6c36-46a5-ba9a-52ee66b82491 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:03.117271 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 681/1388] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:38:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:38:05.238047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d111f91-e379-4413-8c3e-ef9d4cf45667 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:05.238592 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d111f91-e379-4413-8c3e-ef9d4cf45667 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:05.238592 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d111f91-e379-4413-8c3e-ef9d4cf45667 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:05.240001 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 708/1389] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:05.246320 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e837dd6-fde6-4df6-9f15-011f055fb785 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:05.246730 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e837dd6-fde6-4df6-9f15-011f055fb785 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:05.246863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e837dd6-fde6-4df6-9f15-011f055fb785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:05.272342 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fb91d-d736-4b0d-97bf-300d9a22bf0b None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:05.272626 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fb91d-d736-4b0d-97bf-300d9a22bf0b None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:05.273172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fb91d-d736-4b0d-97bf-300d9a22bf0b None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:05.274600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 709/1390] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:38:05.279930 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90251d-80e4-4f2f-823b-646c5792c5d8 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:05.280213 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90251d-80e4-4f2f-823b-646c5792c5d8 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:05.280485 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90251d-80e4-4f2f-823b-646c5792c5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:05.316556 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-2e837dd6-fde6-4df6-9f15-011f055fb785 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:05.317813 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2e837dd6-fde6-4df6-9f15-011f055fb785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:05.350196 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-8a90251d-80e4-4f2f-823b-646c5792c5d8 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:05.351409 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-8a90251d-80e4-4f2f-823b-646c5792c5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:05.416694 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 682/1391] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:38:05.454152 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 710/1392] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:38:05.712053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e837dd6-fde6-4df6-9f15-011f055fb785 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:05.714030 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2e837dd6-fde6-4df6-9f15-011f055fb785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:05.728973 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:05.757466 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d6899-61e5-41a1-851d-bfd4dbbd2990 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:05.757748 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d6899-61e5-41a1-851d-bfd4dbbd2990 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:05.758018 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d6899-61e5-41a1-851d-bfd4dbbd2990 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:05.759336 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 711/1393] 10.222.0.62 () {54 vars in 967 bytes} [Mon Aug 22 20:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:38:05.764759 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7c167-9b5c-40f7-b4e0-3aeb763687dc None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:05.765048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7c167-9b5c-40f7-b4e0-3aeb763687dc None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:05.765456 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7c167-9b5c-40f7-b4e0-3aeb763687dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:05.782022 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:05.832948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e837dd6-fde6-4df6-9f15-011f055fb785 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:05.848826 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-10b7c167-9b5c-40f7-b4e0-3aeb763687dc None None] MFA Rules not processed for user `d4e298bcbaf84866b4fc6c6f65216fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:05.850042 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-10b7c167-9b5c-40f7-b4e0-3aeb763687dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:05.927467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 712/1394] 10.222.0.62 () {58 vars in 1064 bytes} [Mon Aug 22 20:38:05 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:38:05.935828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7c167-9b5c-40f7-b4e0-3aeb763687dc None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:05.943193 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7c167-9b5c-40f7-b4e0-3aeb763687dc None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:05.952030 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb5058-975d-426e-8b9c-da266bda10fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1738f72b4848499cdf0ec6866c3c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:05.952922 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb5058-975d-426e-8b9c-da266bda10fb service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:05.952922 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb5058-975d-426e-8b9c-da266bda10fb service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:05.953125 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb5058-975d-426e-8b9c-da266bda10fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:05.954710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-12fb5058-975d-426e-8b9c-da266bda10fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:05.963916 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:06.018957 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1c866-6881-4a88-89c5-0e229fb935fa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e298bcbaf84866b4fc6c6f65216fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:06.019558 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1c866-6881-4a88-89c5-0e229fb935fa service glance] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:06.019835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1c866-6881-4a88-89c5-0e229fb935fa service glance] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:06.020098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1c866-6881-4a88-89c5-0e229fb935fa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:06.021720 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-beb1c866-6881-4a88-89c5-0e229fb935fa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:06.048600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb5058-975d-426e-8b9c-da266bda10fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:06.050360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb5058-975d-426e-8b9c-da266bda10fb service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:06.052437 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:06.069013 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 683/1395] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:38:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:38:06.136000 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1c866-6881-4a88-89c5-0e229fb935fa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:06.136950 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1c866-6881-4a88-89c5-0e229fb935fa service glance] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:06.156421 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 713/1396] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:38:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:38:07.067601 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f49df-9353-424b-b7c0-144acaa7ed32 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:07.070313 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f49df-9353-424b-b7c0-144acaa7ed32 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:07.070313 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f49df-9353-424b-b7c0-144acaa7ed32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:07.136013 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-8f5f49df-9353-424b-b7c0-144acaa7ed32 None None] MFA Rules not processed for user `51ed4c996cde4e88be26544c48200695`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:07.137611 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8f5f49df-9353-424b-b7c0-144acaa7ed32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:07.222056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:07.225470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 684/1397] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Aug 22 20:38:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:38:07.269975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002d0e4-62d1-4780-a383-25df3c421f66 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:07.270488 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002d0e4-62d1-4780-a383-25df3c421f66 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:07.270587 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002d0e4-62d1-4780-a383-25df3c421f66 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:07.271965 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 714/1398] 10.222.0.62 () {54 vars in 943 bytes} [Mon Aug 22 20:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:07.278441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54385a-01db-4dbe-ba78-3abe66b84767 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:07.278851 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54385a-01db-4dbe-ba78-3abe66b84767 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:07.279133 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54385a-01db-4dbe-ba78-3abe66b84767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:07.358797 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-db54385a-01db-4dbe-ba78-3abe66b84767 None None] MFA Rules not processed for user `907607fd209b416ba9b68512772c1d17`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:07.360007 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-db54385a-01db-4dbe-ba78-3abe66b84767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:07.468149 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 685/1399] 10.222.0.62 () {58 vars in 1040 bytes} [Mon Aug 22 20:38:07 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:38:07.477494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002d0e4-62d1-4780-a383-25df3c421f66 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:07.479602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-6002d0e4-62d1-4780-a383-25df3c421f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:07.615281 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:07.617803 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002d0e4-62d1-4780-a383-25df3c421f66 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:07.721555 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f87e3b-42ea-4d33-8747-1a79cd292324 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '907607fd209b416ba9b68512772c1d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:07.722167 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f87e3b-42ea-4d33-8747-1a79cd292324 service swift] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:07.722445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f87e3b-42ea-4d33-8747-1a79cd292324 service swift] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:07.723018 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f87e3b-42ea-4d33-8747-1a79cd292324 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:07.724761 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-75f87e3b-42ea-4d33-8747-1a79cd292324 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:07.811431 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f87e3b-42ea-4d33-8747-1a79cd292324 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:07.813423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f87e3b-42ea-4d33-8747-1a79cd292324 service swift] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:07.821694 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 715/1400] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Aug 22 20:38:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 22 20:38:08.136914 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86d673-4641-478a-8d5d-626de8636e5e None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:08.137676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86d673-4641-478a-8d5d-626de8636e5e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:08.137676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86d673-4641-478a-8d5d-626de8636e5e None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:08.138779 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 686/1401] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:08.144183 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9318a4c-8caa-43ec-bb4f-cf8598b84875 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:08.144464 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9318a4c-8caa-43ec-bb4f-cf8598b84875 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:08.144767 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9318a4c-8caa-43ec-bb4f-cf8598b84875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:08.187478 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:08.222537 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-b9318a4c-8caa-43ec-bb4f-cf8598b84875 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:08.223900 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b9318a4c-8caa-43ec-bb4f-cf8598b84875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:08.336737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 716/1402] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:38:08.623355 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86d673-4641-478a-8d5d-626de8636e5e None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:08.624936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-df86d673-4641-478a-8d5d-626de8636e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:08.700431 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:08.803824 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86d673-4641-478a-8d5d-626de8636e5e None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:08.934027 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d866b-c97e-4a2a-bc87-cbc2544623e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1738f72b4848499cdf0ec6866c3c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:08.934643 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d866b-c97e-4a2a-bc87-cbc2544623e9 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:08.934924 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d866b-c97e-4a2a-bc87-cbc2544623e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:08.935325 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d866b-c97e-4a2a-bc87-cbc2544623e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:08.937737 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b11d866b-c97e-4a2a-bc87-cbc2544623e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:08.962617 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:09.049051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d866b-c97e-4a2a-bc87-cbc2544623e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:09.050932 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d866b-c97e-4a2a-bc87-cbc2544623e9 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:09.074328 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 687/1403] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:38:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:38:11.908054 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcd6aa-2810-4dbd-801c-f657d7ad9c35 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:11.908677 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcd6aa-2810-4dbd-801c-f657d7ad9c35 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:11.908677 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcd6aa-2810-4dbd-801c-f657d7ad9c35 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:11.910126 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 717/1404] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:11.916350 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b57365-cd6a-470e-b3ca-cedea096db12 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:11.916350 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b57365-cd6a-470e-b3ca-cedea096db12 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:11.916350 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b57365-cd6a-470e-b3ca-cedea096db12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:11.991500 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-31b57365-cd6a-470e-b3ca-cedea096db12 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:11.992779 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-31b57365-cd6a-470e-b3ca-cedea096db12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:12.098982 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:12.106166 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 688/1405] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:38:12.410061 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcd6aa-2810-4dbd-801c-f657d7ad9c35 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:12.411622 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-82dcd6aa-2810-4dbd-801c-f657d7ad9c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:12.529771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:12.582076 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcd6aa-2810-4dbd-801c-f657d7ad9c35 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:12.710381 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3cdc90-71d4-4e8e-92f9-2f16681eb153 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1738f72b4848499cdf0ec6866c3c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:12.710961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3cdc90-71d4-4e8e-92f9-2f16681eb153 service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:12.711247 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3cdc90-71d4-4e8e-92f9-2f16681eb153 service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:12.711521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3cdc90-71d4-4e8e-92f9-2f16681eb153 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:12.714041 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-cf3cdc90-71d4-4e8e-92f9-2f16681eb153 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:12.803900 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:12.826407 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3cdc90-71d4-4e8e-92f9-2f16681eb153 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:12.828178 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3cdc90-71d4-4e8e-92f9-2f16681eb153 service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:12.848699 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 718/1406] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:38:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:38:14.983312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddeee6a-4500-4904-90da-13e3a2cd5ff5 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:14.983882 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddeee6a-4500-4904-90da-13e3a2cd5ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:14.983882 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddeee6a-4500-4904-90da-13e3a2cd5ff5 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:14.985215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 689/1407] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:14.992012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0c2de-89ea-4602-83a5-5a7b08819a04 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:14.992467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0c2de-89ea-4602-83a5-5a7b08819a04 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:14.992546 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c0c2de-89ea-4602-83a5-5a7b08819a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:15.092770 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-76c0c2de-89ea-4602-83a5-5a7b08819a04 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:15.094088 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-76c0c2de-89ea-4602-83a5-5a7b08819a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:15.232432 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 719/1408] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:38:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:38:15.598972 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddeee6a-4500-4904-90da-13e3a2cd5ff5 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:15.599864 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7ddeee6a-4500-4904-90da-13e3a2cd5ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:15.769979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddeee6a-4500-4904-90da-13e3a2cd5ff5 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:15.857822 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:15.914385 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfff9a4-3115-4da5-94db-7a8e8ba1d091 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1738f72b4848499cdf0ec6866c3c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:15.915019 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfff9a4-3115-4da5-94db-7a8e8ba1d091 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:15.916344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfff9a4-3115-4da5-94db-7a8e8ba1d091 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:15.916638 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfff9a4-3115-4da5-94db-7a8e8ba1d091 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:15.918329 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-7cfff9a4-3115-4da5-94db-7a8e8ba1d091 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:16.033376 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfff9a4-3115-4da5-94db-7a8e8ba1d091 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:16.034997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfff9a4-3115-4da5-94db-7a8e8ba1d091 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:16.053723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 690/1409] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:38:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:38:25.229598 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=79 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:26.051137 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=64 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:31.799476 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814c628-6675-4edf-9711-d7c8b5cca231 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:31.799967 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814c628-6675-4edf-9711-d7c8b5cca231 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:31.800077 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814c628-6675-4edf-9711-d7c8b5cca231 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:31.801429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 720/1410] 10.222.0.62 () {54 vars in 918 bytes} [Mon Aug 22 20:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:31.807718 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969c9fb-08dd-400e-b9a8-4d31a30b4f04 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:31.808172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969c9fb-08dd-400e-b9a8-4d31a30b4f04 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:31.808276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969c9fb-08dd-400e-b9a8-4d31a30b4f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:31.883450 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-5969c9fb-08dd-400e-b9a8-4d31a30b4f04 None None] MFA Rules not processed for user `d3fdb2336b8b4f7c9b710b224a8594a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:31.884755 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5969c9fb-08dd-400e-b9a8-4d31a30b4f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:31.991178 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 691/1411] 10.222.0.62 () {58 vars in 1015 bytes} [Mon Aug 22 20:38:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:38:32.005917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614bf09-f78b-4afc-b985-cb94bf146632 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:32.006200 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614bf09-f78b-4afc-b985-cb94bf146632 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:32.006469 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614bf09-f78b-4afc-b985-cb94bf146632 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:32.007780 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 721/1412] 10.222.0.62 () {54 vars in 918 bytes} [Mon Aug 22 20:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:32.012362 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51651bc-8120-4d53-8fd6-9e749859b1fc None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:32.012646 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51651bc-8120-4d53-8fd6-9e749859b1fc None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:32.012941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51651bc-8120-4d53-8fd6-9e749859b1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:32.084746 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:32.087816 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-d51651bc-8120-4d53-8fd6-9e749859b1fc None None] MFA Rules not processed for user `9f1738f72b4848499cdf0ec6866c3c8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:32.089057 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d51651bc-8120-4d53-8fd6-9e749859b1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:32.204211 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 692/1413] 10.222.0.62 () {58 vars in 1015 bytes} [Mon Aug 22 20:38:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:38:34.588547 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff7a4e-75ce-442e-b294-97ebd301c599 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:34.589124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff7a4e-75ce-442e-b294-97ebd301c599 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:34.589124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff7a4e-75ce-442e-b294-97ebd301c599 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:34.590459 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 722/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:38:34.595684 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091b720-13f0-4d12-a819-17fe4eab8da0 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:34.596126 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091b720-13f0-4d12-a819-17fe4eab8da0 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:34.596233 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091b720-13f0-4d12-a819-17fe4eab8da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:34.664113 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-6091b720-13f0-4d12-a819-17fe4eab8da0 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:34.665976 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6091b720-13f0-4d12-a819-17fe4eab8da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:34.720156 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:34.761633 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 693/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:38:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:38:35.052986 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff7a4e-75ce-442e-b294-97ebd301c599 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:35.054570 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-2cff7a4e-75ce-442e-b294-97ebd301c599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:35.202367 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff7a4e-75ce-442e-b294-97ebd301c599 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:35.274936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:35.316561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b0059-8fe6-48b1-82b2-f47b77a8340c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1738f72b4848499cdf0ec6866c3c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:35.317459 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b0059-8fe6-48b1-82b2-f47b77a8340c service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:35.317730 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b0059-8fe6-48b1-82b2-f47b77a8340c service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:35.317996 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b0059-8fe6-48b1-82b2-f47b77a8340c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:35.319612 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-413b0059-8fe6-48b1-82b2-f47b77a8340c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:35.409049 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b0059-8fe6-48b1-82b2-f47b77a8340c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:35.410647 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b0059-8fe6-48b1-82b2-f47b77a8340c service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:35.428422 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 723/1416] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:38:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:38:36.321519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804d4d8-a903-48b5-8e3f-8cd0393cf95e None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:36.322087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804d4d8-a903-48b5-8e3f-8cd0393cf95e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:36.322087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b804d4d8-a903-48b5-8e3f-8cd0393cf95e None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:36.323437 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 694/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:36.328355 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d78ebd-c93e-431d-962b-6013e06a83d3 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:36.328800 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d78ebd-c93e-431d-962b-6013e06a83d3 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:36.328925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d78ebd-c93e-431d-962b-6013e06a83d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:36.403254 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-59d78ebd-c93e-431d-962b-6013e06a83d3 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:36.404447 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-59d78ebd-c93e-431d-962b-6013e06a83d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:36.430570 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:36.501798 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 724/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:38:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:38:36.656396 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804d4d8-a903-48b5-8e3f-8cd0393cf95e None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:36.657953 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b804d4d8-a903-48b5-8e3f-8cd0393cf95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:36.806856 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b804d4d8-a903-48b5-8e3f-8cd0393cf95e None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:36.847614 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:36.921770 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15abaa-b644-4d29-a1ab-234433ad984a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1738f72b4848499cdf0ec6866c3c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:36.922306 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15abaa-b644-4d29-a1ab-234433ad984a service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:36.922586 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15abaa-b644-4d29-a1ab-234433ad984a service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:36.922858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15abaa-b644-4d29-a1ab-234433ad984a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:36.924473 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3f15abaa-b644-4d29-a1ab-234433ad984a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:37.015792 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15abaa-b644-4d29-a1ab-234433ad984a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:37.017437 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15abaa-b644-4d29-a1ab-234433ad984a service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:37.035964 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 695/1419] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:38:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:38:37.924305 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef9037-8fda-4a5d-849f-2d6892b8ef40 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:37.924884 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef9037-8fda-4a5d-849f-2d6892b8ef40 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:37.924884 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef9037-8fda-4a5d-849f-2d6892b8ef40 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:37.926228 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 725/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:38:37.932002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a7b9c-8b16-45f2-8830-04ff70ee95ae None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:37.932416 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a7b9c-8b16-45f2-8830-04ff70ee95ae None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:37.932519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a7b9c-8b16-45f2-8830-04ff70ee95ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:37.988441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:38.010586 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-4a6a7b9c-8b16-45f2-8830-04ff70ee95ae None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:38.011818 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4a6a7b9c-8b16-45f2-8830-04ff70ee95ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:38.106700 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 696/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:38:38.268039 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef9037-8fda-4a5d-849f-2d6892b8ef40 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:38.269604 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-98ef9037-8fda-4a5d-849f-2d6892b8ef40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:38.416326 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef9037-8fda-4a5d-849f-2d6892b8ef40 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:38.428218 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:38.529112 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7523fd8-174b-4f62-b4d2-e0e713ddb650 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1738f72b4848499cdf0ec6866c3c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:38.529750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7523fd8-174b-4f62-b4d2-e0e713ddb650 service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:38.530031 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7523fd8-174b-4f62-b4d2-e0e713ddb650 service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:38.530307 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7523fd8-174b-4f62-b4d2-e0e713ddb650 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:38.531915 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-f7523fd8-174b-4f62-b4d2-e0e713ddb650 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:38.622290 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7523fd8-174b-4f62-b4d2-e0e713ddb650 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:38.623880 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7523fd8-174b-4f62-b4d2-e0e713ddb650 service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:38.642324 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 726/1422] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:38:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:38:39.499678 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e0316-3985-4414-880a-91f3ec4cc459 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:39.500255 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e0316-3985-4414-880a-91f3ec4cc459 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:39.500255 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e0316-3985-4414-880a-91f3ec4cc459 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:39.501661 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 697/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:38:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:39.506401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58a882-bddd-46bd-ba5e-c1b9c53cd30e None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:39.506844 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58a882-bddd-46bd-ba5e-c1b9c53cd30e None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:39.506959 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58a882-bddd-46bd-ba5e-c1b9c53cd30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:39.526637 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:39.583281 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-7d58a882-bddd-46bd-ba5e-c1b9c53cd30e None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:39.584476 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-7d58a882-bddd-46bd-ba5e-c1b9c53cd30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:39.680266 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 727/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:38:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:38:39.833015 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e0316-3985-4414-880a-91f3ec4cc459 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:39.834677 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f11e0316-3985-4414-880a-91f3ec4cc459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:39.944079 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:39.981002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e0316-3985-4414-880a-91f3ec4cc459 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:40.093963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf21d59-7c52-423f-891c-9cf02722795b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1738f72b4848499cdf0ec6866c3c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:40.094564 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf21d59-7c52-423f-891c-9cf02722795b service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:40.094850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf21d59-7c52-423f-891c-9cf02722795b service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:40.095094 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf21d59-7c52-423f-891c-9cf02722795b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:40.096705 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2bf21d59-7c52-423f-891c-9cf02722795b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:40.171850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:40.185641 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf21d59-7c52-423f-891c-9cf02722795b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:40.187219 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf21d59-7c52-423f-891c-9cf02722795b service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:40.205614 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 698/1425] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:38:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:38:41.083156 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af671388-b502-4f7f-883d-262788f734c7 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:41.083695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af671388-b502-4f7f-883d-262788f734c7 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:41.083695 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af671388-b502-4f7f-883d-262788f734c7 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:41.085236 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 728/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:41.091026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c400f88-fbcc-44c8-a0be-1455bde47986 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:41.091455 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c400f88-fbcc-44c8-a0be-1455bde47986 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:41.091577 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c400f88-fbcc-44c8-a0be-1455bde47986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:41.173322 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-3c400f88-fbcc-44c8-a0be-1455bde47986 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:41.174561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3c400f88-fbcc-44c8-a0be-1455bde47986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:41.283296 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 699/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:38:41.436387 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af671388-b502-4f7f-883d-262788f734c7 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:41.437922 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-af671388-b502-4f7f-883d-262788f734c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:41.521111 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:41.583749 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af671388-b502-4f7f-883d-262788f734c7 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:41.697435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50bdf6-d2b5-4ac1-9ed7-323d8262bd6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1738f72b4848499cdf0ec6866c3c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:41.698037 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50bdf6-d2b5-4ac1-9ed7-323d8262bd6a service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:41.698317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50bdf6-d2b5-4ac1-9ed7-323d8262bd6a service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:41.698586 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50bdf6-d2b5-4ac1-9ed7-323d8262bd6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:41.700190 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-cb50bdf6-d2b5-4ac1-9ed7-323d8262bd6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:41.749197 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:41.789950 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb50bdf6-d2b5-4ac1-9ed7-323d8262bd6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:41.791577 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb50bdf6-d2b5-4ac1-9ed7-323d8262bd6a service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:41.810849 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 729/1428] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:38:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:38:42.657932 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fff614-63fb-4669-9253-535915036659 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:42.658507 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fff614-63fb-4669-9253-535915036659 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:42.658507 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fff614-63fb-4669-9253-535915036659 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:42.660005 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 700/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:42.664950 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac13bb5-d2e3-4e65-b254-315d4ea35534 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:42.665374 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac13bb5-d2e3-4e65-b254-315d4ea35534 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:42.665497 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac13bb5-d2e3-4e65-b254-315d4ea35534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:42.742112 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-4ac13bb5-d2e3-4e65-b254-315d4ea35534 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:42.743615 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-4ac13bb5-d2e3-4e65-b254-315d4ea35534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:42.842533 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 730/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:38:42.994797 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fff614-63fb-4669-9253-535915036659 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:42.996228 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-07fff614-63fb-4669-9253-535915036659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:43.045509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:43.143884 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fff614-63fb-4669-9253-535915036659 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:43.258493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16595a52-14f6-48ee-a481-41e3dd3442cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1738f72b4848499cdf0ec6866c3c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:43.259068 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16595a52-14f6-48ee-a481-41e3dd3442cd service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:43.259352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16595a52-14f6-48ee-a481-41e3dd3442cd service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:43.259624 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16595a52-14f6-48ee-a481-41e3dd3442cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:43.261268 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-16595a52-14f6-48ee-a481-41e3dd3442cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:43.268149 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:43.354400 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16595a52-14f6-48ee-a481-41e3dd3442cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:43.356055 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16595a52-14f6-48ee-a481-41e3dd3442cd service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:43.374809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 701/1431] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:38:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:38:44.235014 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d298713-f839-4203-bc66-7d7d4e6f4f0e None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:44.235602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d298713-f839-4203-bc66-7d7d4e6f4f0e None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:44.235602 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d298713-f839-4203-bc66-7d7d4e6f4f0e None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:44.236947 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 731/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:44.242485 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdde6a-85fe-47e5-9811-dc6d1b02c859 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:44.242977 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdde6a-85fe-47e5-9811-dc6d1b02c859 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:44.243074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdde6a-85fe-47e5-9811-dc6d1b02c859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:44.318943 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-0ecdde6a-85fe-47e5-9811-dc6d1b02c859 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:44.320226 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0ecdde6a-85fe-47e5-9811-dc6d1b02c859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:44.387759 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:44.416526 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 702/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:38:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:38:44.567272 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d298713-f839-4203-bc66-7d7d4e6f4f0e None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:44.568705 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-8d298713-f839-4203-bc66-7d7d4e6f4f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:44.587260 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:44.716049 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d298713-f839-4203-bc66-7d7d4e6f4f0e None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:44.802463 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:44.829149 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12077498-ca92-4e75-b1c1-83bcb5d1f6fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1738f72b4848499cdf0ec6866c3c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:44.829680 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12077498-ca92-4e75-b1c1-83bcb5d1f6fb service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:44.829958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12077498-ca92-4e75-b1c1-83bcb5d1f6fb service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:44.830228 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12077498-ca92-4e75-b1c1-83bcb5d1f6fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:44.831821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-12077498-ca92-4e75-b1c1-83bcb5d1f6fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:44.919726 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12077498-ca92-4e75-b1c1-83bcb5d1f6fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:44.921334 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12077498-ca92-4e75-b1c1-83bcb5d1f6fb service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:44.938977 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 732/1434] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:38:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:38:45.813371 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bc1ea-52f1-4c51-8df0-ff01470c3cdb None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:45.813879 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bc1ea-52f1-4c51-8df0-ff01470c3cdb None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:45.813987 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bc1ea-52f1-4c51-8df0-ff01470c3cdb None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:45.815255 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 703/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:45.820570 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0b0e9-b77a-436d-8352-2becc19996e7 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:45.821039 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0b0e9-b77a-436d-8352-2becc19996e7 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:45.821148 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0b0e9-b77a-436d-8352-2becc19996e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:45.896337 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-9fe0b0e9-b77a-436d-8352-2becc19996e7 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:45.898075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-9fe0b0e9-b77a-436d-8352-2becc19996e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:45.939928 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:45.994522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 733/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:38:46.146488 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bc1ea-52f1-4c51-8df0-ff01470c3cdb None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:46.148904 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9e3bc1ea-52f1-4c51-8df0-ff01470c3cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:46.291544 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bc1ea-52f1-4c51-8df0-ff01470c3cdb None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:46.345371 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:46.403808 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3d073-0b7c-447f-8e88-d9d8f020577e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1738f72b4848499cdf0ec6866c3c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:46.404431 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3d073-0b7c-447f-8e88-d9d8f020577e service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:46.404738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3d073-0b7c-447f-8e88-d9d8f020577e service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:46.405010 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3d073-0b7c-447f-8e88-d9d8f020577e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:46.406607 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a0c3d073-0b7c-447f-8e88-d9d8f020577e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:46.498021 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c3d073-0b7c-447f-8e88-d9d8f020577e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:46.499649 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c3d073-0b7c-447f-8e88-d9d8f020577e service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:46.518516 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 704/1437] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:38:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:38:47.390147 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ef4d9-946e-4edd-95c7-a728c9d9d836 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:47.390629 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ef4d9-946e-4edd-95c7-a728c9d9d836 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:47.390725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ef4d9-946e-4edd-95c7-a728c9d9d836 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:47.392040 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 734/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:47.397129 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa480f15-e4e7-4642-86d5-6fc7389c4093 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:47.397547 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa480f15-e4e7-4642-86d5-6fc7389c4093 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:47.397712 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa480f15-e4e7-4642-86d5-6fc7389c4093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:47.476760 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-aa480f15-e4e7-4642-86d5-6fc7389c4093 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:47.478495 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-aa480f15-e4e7-4642-86d5-6fc7389c4093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:47.480495 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:47.578490 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 705/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:38:47.738198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ef4d9-946e-4edd-95c7-a728c9d9d836 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:47.739707 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-317ef4d9-946e-4edd-95c7-a728c9d9d836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:47.884840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ef4d9-946e-4edd-95c7-a728c9d9d836 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:47.910755 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:47.997772 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3991b-cc80-40c0-81d2-35d7848f9840 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1738f72b4848499cdf0ec6866c3c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:47.998287 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3991b-cc80-40c0-81d2-35d7848f9840 service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:47.998563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3991b-cc80-40c0-81d2-35d7848f9840 service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:47.998830 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3991b-cc80-40c0-81d2-35d7848f9840 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:48.000415 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-1ec3991b-cc80-40c0-81d2-35d7848f9840 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:48.087563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3991b-cc80-40c0-81d2-35d7848f9840 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:48.089130 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3991b-cc80-40c0-81d2-35d7848f9840 service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:48.107162 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 735/1440] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:38:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:38:49.925312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4e9f6-1aa0-48e9-afe0-80b6dbffe336 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:49.925872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4e9f6-1aa0-48e9-afe0-80b6dbffe336 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:49.925872 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4e9f6-1aa0-48e9-afe0-80b6dbffe336 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:49.927190 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 706/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:49.933496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263592c-2e38-4179-9fb7-63c07d110a3d None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:49.933919 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263592c-2e38-4179-9fb7-63c07d110a3d None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:49.934031 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263592c-2e38-4179-9fb7-63c07d110a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:49.974898 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:50.000330 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-1263592c-2e38-4179-9fb7-63c07d110a3d None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:50.001568 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-1263592c-2e38-4179-9fb7-63c07d110a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:50.099143 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 736/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:38:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:38:50.380784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4e9f6-1aa0-48e9-afe0-80b6dbffe336 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:50.382321 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b9c4e9f6-1aa0-48e9-afe0-80b6dbffe336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:50.487460 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4e9f6-1aa0-48e9-afe0-80b6dbffe336 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:50.518391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:50.559674 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6666b07a-0469-4c0f-a611-debf8ee097de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:50.560269 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666b07a-0469-4c0f-a611-debf8ee097de service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:50.560545 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666b07a-0469-4c0f-a611-debf8ee097de service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:50.560843 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6666b07a-0469-4c0f-a611-debf8ee097de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:50.562432 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6666b07a-0469-4c0f-a611-debf8ee097de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:50.669202 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666b07a-0469-4c0f-a611-debf8ee097de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:50.670653 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6666b07a-0469-4c0f-a611-debf8ee097de service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:50.689326 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 707/1443] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:38:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:38:52.789359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6b037-18d2-4d22-b7d2-755e27022413 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:52.790698 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6b037-18d2-4d22-b7d2-755e27022413 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:52.790803 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6b037-18d2-4d22-b7d2-755e27022413 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:52.792078 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 737/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:38:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:52.798128 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2094f14-845a-40f4-82bb-ba18583726d4 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:52.798539 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2094f14-845a-40f4-82bb-ba18583726d4 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:52.798685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2094f14-845a-40f4-82bb-ba18583726d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:52.865074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-c2094f14-845a-40f4-82bb-ba18583726d4 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:52.866285 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-c2094f14-845a-40f4-82bb-ba18583726d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:52.878958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:52.978312 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 708/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:38:53.271834 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6b037-18d2-4d22-b7d2-755e27022413 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:53.273416 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-a3b6b037-18d2-4d22-b7d2-755e27022413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:53.376325 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6b037-18d2-4d22-b7d2-755e27022413 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:53.389354 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:53.451765 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13daca7-0881-4369-8982-0329ca939102 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:53.452361 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13daca7-0881-4369-8982-0329ca939102 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:53.452636 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13daca7-0881-4369-8982-0329ca939102 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:53.452928 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13daca7-0881-4369-8982-0329ca939102 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:53.454515 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-c13daca7-0881-4369-8982-0329ca939102 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:53.563626 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13daca7-0881-4369-8982-0329ca939102 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:53.565017 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13daca7-0881-4369-8982-0329ca939102 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:53.583847 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 738/1446] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:38:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:38:55.879727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc92e0-0a79-4179-991b-267f9183dba4 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:55.880280 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc92e0-0a79-4179-991b-267f9183dba4 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:55.880280 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc92e0-0a79-4179-991b-267f9183dba4 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:55.881647 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 709/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:55.887472 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1065e7-b090-479a-8106-02472382da7b None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:55.887894 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1065e7-b090-479a-8106-02472382da7b None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:55.888017 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1065e7-b090-479a-8106-02472382da7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:55.935828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:55.953847 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-4d1065e7-b090-479a-8106-02472382da7b None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:55.955048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-4d1065e7-b090-479a-8106-02472382da7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:56.051096 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 739/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:38:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:38:56.335656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc92e0-0a79-4179-991b-267f9183dba4 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:56.338351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-dabc92e0-0a79-4179-991b-267f9183dba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:56.446192 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc92e0-0a79-4179-991b-267f9183dba4 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:56.486419 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:56.520218 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb0718-a3c9-4394-8951-8abc1cef380c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:56.520869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb0718-a3c9-4394-8951-8abc1cef380c service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:56.521151 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb0718-a3c9-4394-8951-8abc1cef380c service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:56.521424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb0718-a3c9-4394-8951-8abc1cef380c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:56.523039 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-46cb0718-a3c9-4394-8951-8abc1cef380c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:56.632050 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb0718-a3c9-4394-8951-8abc1cef380c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:56.633973 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb0718-a3c9-4394-8951-8abc1cef380c service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:56.653341 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 710/1449] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:38:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:38:58.713343 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c5c0a-cd58-4d81-8de5-516e0a15483b None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:58.713929 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c5c0a-cd58-4d81-8de5-516e0a15483b None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:58.713929 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c5c0a-cd58-4d81-8de5-516e0a15483b None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:58.715261 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 740/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:38:58.720483 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872c584-bfed-4473-a979-94dcebe61f0c None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:58.720920 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872c584-bfed-4473-a979-94dcebe61f0c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:58.721059 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872c584-bfed-4473-a979-94dcebe61f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:58.790086 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-2872c584-bfed-4473-a979-94dcebe61f0c None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:38:58.791318 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2872c584-bfed-4473-a979-94dcebe61f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:58.812940 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:58.889474 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 711/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:38:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:38:59.176574 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c5c0a-cd58-4d81-8de5-516e0a15483b None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:38:59.178124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-959c5c0a-cd58-4d81-8de5-516e0a15483b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:59.280731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c5c0a-cd58-4d81-8de5-516e0a15483b None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:38:59.300391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:38:59.356253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccca4a-1c19-4360-85af-8faa891836c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:38:59.356557 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccca4a-1c19-4360-85af-8faa891836c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:38:59.356930 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccca4a-1c19-4360-85af-8faa891836c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:38:59.357200 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccca4a-1c19-4360-85af-8faa891836c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:38:59.358811 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-d8ccca4a-1c19-4360-85af-8faa891836c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:38:59.470842 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ccca4a-1c19-4360-85af-8faa891836c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:38:59.472195 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ccca4a-1c19-4360-85af-8faa891836c8 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:38:59.490905 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 741/1452] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:38:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:39:01.447629 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f002a71-a3ab-4a5b-b925-c52897eb2866 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:01.448182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f002a71-a3ab-4a5b-b925-c52897eb2866 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:01.448296 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f002a71-a3ab-4a5b-b925-c52897eb2866 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:01.449576 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 712/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:01.455048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864b3ef-b179-4dbf-85cb-c691e29f1b69 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:01.455475 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864b3ef-b179-4dbf-85cb-c691e29f1b69 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:01.455580 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864b3ef-b179-4dbf-85cb-c691e29f1b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:01.518912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:01.521781 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-0864b3ef-b179-4dbf-85cb-c691e29f1b69 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:01.522984 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-0864b3ef-b179-4dbf-85cb-c691e29f1b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:01.619769 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 742/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:39:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:39:01.906503 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f002a71-a3ab-4a5b-b925-c52897eb2866 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:01.908064 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0f002a71-a3ab-4a5b-b925-c52897eb2866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:02.011376 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f002a71-a3ab-4a5b-b925-c52897eb2866 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:02.060474 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:02.085016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6260f-e87b-4df3-9001-f0a1e09c28bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:02.085615 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6260f-e87b-4df3-9001-f0a1e09c28bf service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:02.085916 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6260f-e87b-4df3-9001-f0a1e09c28bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:02.086185 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6260f-e87b-4df3-9001-f0a1e09c28bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:02.087914 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-29a6260f-e87b-4df3-9001-f0a1e09c28bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:02.196333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a6260f-e87b-4df3-9001-f0a1e09c28bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:02.197724 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a6260f-e87b-4df3-9001-f0a1e09c28bf service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:02.216093 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 713/1455] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:39:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:39:04.174148 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a5655-d1fb-4727-b1f8-f97e9d88eb82 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:04.174748 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a5655-d1fb-4727-b1f8-f97e9d88eb82 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:04.174748 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a5655-d1fb-4727-b1f8-f97e9d88eb82 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:04.176065 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 743/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:04.182151 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f21afe-a51b-40c8-b8c2-4b28064a5669 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:04.182599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f21afe-a51b-40c8-b8c2-4b28064a5669 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:04.182720 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f21afe-a51b-40c8-b8c2-4b28064a5669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:04.247383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-f1f21afe-a51b-40c8-b8c2-4b28064a5669 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:04.248581 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f1f21afe-a51b-40c8-b8c2-4b28064a5669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:04.279029 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:04.345231 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 714/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:39:04.630176 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a5655-d1fb-4727-b1f8-f97e9d88eb82 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:04.631750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-610a5655-d1fb-4727-b1f8-f97e9d88eb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:04.735291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a5655-d1fb-4727-b1f8-f97e9d88eb82 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:04.764073 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:04.813172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b7b03-c309-47c5-876f-cd501d26444b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:04.813773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b7b03-c309-47c5-876f-cd501d26444b service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:04.814047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b7b03-c309-47c5-876f-cd501d26444b service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:04.814315 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b7b03-c309-47c5-876f-cd501d26444b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:04.815902 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-6e4b7b03-c309-47c5-876f-cd501d26444b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:04.926667 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b7b03-c309-47c5-876f-cd501d26444b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:04.928107 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b7b03-c309-47c5-876f-cd501d26444b service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:04.947160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 744/1458] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:39:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:39:06.900779 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c966fb6-0202-4f48-9fcd-acef879a2559 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:06.901338 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c966fb6-0202-4f48-9fcd-acef879a2559 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:06.901338 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c966fb6-0202-4f48-9fcd-acef879a2559 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:06.902690 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 715/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:06.908045 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0910d88-2f29-4396-8592-eedb1e3ff414 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:06.908433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0910d88-2f29-4396-8592-eedb1e3ff414 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:06.908596 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0910d88-2f29-4396-8592-eedb1e3ff414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:06.973189 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-b0910d88-2f29-4396-8592-eedb1e3ff414 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:06.974389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b0910d88-2f29-4396-8592-eedb1e3ff414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:06.983336 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:07.071993 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 745/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:39:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:39:07.355846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c966fb6-0202-4f48-9fcd-acef879a2559 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:07.357437 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3c966fb6-0202-4f48-9fcd-acef879a2559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:07.464714 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c966fb6-0202-4f48-9fcd-acef879a2559 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:07.524052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:07.543290 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a7347-b87e-4936-ac01-aff32fe62c0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:07.543895 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a7347-b87e-4936-ac01-aff32fe62c0b service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:07.544174 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a7347-b87e-4936-ac01-aff32fe62c0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:07.544443 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a7347-b87e-4936-ac01-aff32fe62c0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:07.546160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-741a7347-b87e-4936-ac01-aff32fe62c0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:07.654771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a7347-b87e-4936-ac01-aff32fe62c0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:07.656223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a7347-b87e-4936-ac01-aff32fe62c0b service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:07.674156 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 716/1461] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:39:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:39:09.649925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2bacf-0f78-4239-8106-7913018daa83 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:09.650488 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2bacf-0f78-4239-8106-7913018daa83 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:09.650488 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2bacf-0f78-4239-8106-7913018daa83 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:09.651811 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 746/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:09.657100 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5e99c-6529-48c8-9744-855dadf111d8 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:09.657560 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5e99c-6529-48c8-9744-855dadf111d8 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:09.657664 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5e99c-6529-48c8-9744-855dadf111d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:09.724328 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-8cb5e99c-6529-48c8-9744-855dadf111d8 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:09.725611 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8cb5e99c-6529-48c8-9744-855dadf111d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:09.764238 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:09.824904 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 717/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:39:10.110394 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2bacf-0f78-4239-8106-7913018daa83 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:10.111952 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-c0d2bacf-0f78-4239-8106-7913018daa83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:10.217518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2bacf-0f78-4239-8106-7913018daa83 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:10.255106 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:10.291962 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc6904-19f5-451b-9111-15bc3b463d23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:10.292557 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc6904-19f5-451b-9111-15bc3b463d23 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:10.292931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc6904-19f5-451b-9111-15bc3b463d23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:10.293202 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc6904-19f5-451b-9111-15bc3b463d23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:10.294783 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-97dc6904-19f5-451b-9111-15bc3b463d23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:10.402504 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc6904-19f5-451b-9111-15bc3b463d23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:10.403977 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc6904-19f5-451b-9111-15bc3b463d23 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:10.423498 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 747/1464] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:39:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:39:12.374213 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69d539-f0fd-4b63-8d76-f25f4d3dd8de None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:12.374752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69d539-f0fd-4b63-8d76-f25f4d3dd8de None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:12.374752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69d539-f0fd-4b63-8d76-f25f4d3dd8de None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:12.376074 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 718/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:12.381503 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b32ad-4f46-42af-b032-bbbd84a823a0 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:12.382435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b32ad-4f46-42af-b032-bbbd84a823a0 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:12.382705 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b32ad-4f46-42af-b032-bbbd84a823a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:12.450272 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-3d4b32ad-4f46-42af-b032-bbbd84a823a0 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:12.460132 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-3d4b32ad-4f46-42af-b032-bbbd84a823a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:12.470134 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:12.550850 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 748/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:39:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:39:12.834300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69d539-f0fd-4b63-8d76-f25f4d3dd8de None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:12.836371 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0b69d539-f0fd-4b63-8d76-f25f4d3dd8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:12.939221 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69d539-f0fd-4b63-8d76-f25f4d3dd8de None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:13.005781 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:13.012421 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326dc65-a6ba-489e-bd02-f08bd6c83bb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:13.013087 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326dc65-a6ba-489e-bd02-f08bd6c83bb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:13.013365 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326dc65-a6ba-489e-bd02-f08bd6c83bb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:13.020580 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326dc65-a6ba-489e-bd02-f08bd6c83bb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:13.020580 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4326dc65-a6ba-489e-bd02-f08bd6c83bb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:13.123694 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4326dc65-a6ba-489e-bd02-f08bd6c83bb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:13.125090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4326dc65-a6ba-489e-bd02-f08bd6c83bb7 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:13.143097 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 719/1467] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:39:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:39:15.074223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bfd6a0-08b5-4870-a665-c983fe604e76 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:15.074781 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bfd6a0-08b5-4870-a665-c983fe604e76 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:15.074781 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bfd6a0-08b5-4870-a665-c983fe604e76 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:15.076044 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 749/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:39:15.081636 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d6467-3d4e-4f06-8325-c0c5a70d275c None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:15.082099 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d6467-3d4e-4f06-8325-c0c5a70d275c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:15.082196 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d6467-3d4e-4f06-8325-c0c5a70d275c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:15.150135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-4d6d6467-3d4e-4f06-8325-c0c5a70d275c None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:15.151361 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-4d6d6467-3d4e-4f06-8325-c0c5a70d275c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:15.200391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:15.248276 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 720/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:39:15.541309 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bfd6a0-08b5-4870-a665-c983fe604e76 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:15.542833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-95bfd6a0-08b5-4870-a665-c983fe604e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:15.648871 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bfd6a0-08b5-4870-a665-c983fe604e76 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:15.697031 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:15.723027 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090d233-206e-4db5-90e2-92e22da50728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:15.723629 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090d233-206e-4db5-90e2-92e22da50728 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:15.723931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090d233-206e-4db5-90e2-92e22da50728 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:15.724207 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090d233-206e-4db5-90e2-92e22da50728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:15.726092 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-9090d233-206e-4db5-90e2-92e22da50728 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:15.835853 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9090d233-206e-4db5-90e2-92e22da50728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:15.837310 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9090d233-206e-4db5-90e2-92e22da50728 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:15.855287 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 750/1470] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:39:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:39:25.246555 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=22 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:25.853103 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=66 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:35.607503 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cb747-811a-467c-9900-0f132edb0237 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:35.608072 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cb747-811a-467c-9900-0f132edb0237 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:35.608072 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cb747-811a-467c-9900-0f132edb0237 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:35.609428 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 721/1471] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:35.614823 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7d17c-47e0-4c13-8e93-7109dea400bd None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:35.615260 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7d17c-47e0-4c13-8e93-7109dea400bd None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:35.615434 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7d17c-47e0-4c13-8e93-7109dea400bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:35.681981 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-60b7d17c-47e0-4c13-8e93-7109dea400bd None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:35.683186 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-60b7d17c-47e0-4c13-8e93-7109dea400bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:35.778948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 751/1472] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:39:36.076148 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d834a7-9b1c-4b80-9977-ad13f1788276 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:36.076432 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d834a7-9b1c-4b80-9977-ad13f1788276 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:36.076746 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d834a7-9b1c-4b80-9977-ad13f1788276 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:36.078070 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 722/1473] 10.222.0.62 () {54 vars in 967 bytes} [Mon Aug 22 20:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:36.083019 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd556b-6899-4f22-8869-63ef732f1c9b None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:36.083335 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd556b-6899-4f22-8869-63ef732f1c9b None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:36.083613 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd556b-6899-4f22-8869-63ef732f1c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:36.158080 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-f5cd556b-6899-4f22-8869-63ef732f1c9b None None] MFA Rules not processed for user `d4e298bcbaf84866b4fc6c6f65216fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:36.159284 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-f5cd556b-6899-4f22-8869-63ef732f1c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:36.180093 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:36.234089 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 752/1474] 10.222.0.62 () {58 vars in 1064 bytes} [Mon Aug 22 20:39:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:39:36.242520 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d834a7-9b1c-4b80-9977-ad13f1788276 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:36.244080 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-89d834a7-9b1c-4b80-9977-ad13f1788276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:36.350182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d834a7-9b1c-4b80-9977-ad13f1788276 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:36.422481 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c9eb8-7f92-4d15-bda7-7e27a4c110a3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e298bcbaf84866b4fc6c6f65216fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:36.423085 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c9eb8-7f92-4d15-bda7-7e27a4c110a3 service glance] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:36.423359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c9eb8-7f92-4d15-bda7-7e27a4c110a3 service glance] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:36.423628 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c9eb8-7f92-4d15-bda7-7e27a4c110a3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:36.425266 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b96c9eb8-7f92-4d15-bda7-7e27a4c110a3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:36.479612 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:36.536065 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c9eb8-7f92-4d15-bda7-7e27a4c110a3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:36.538134 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c9eb8-7f92-4d15-bda7-7e27a4c110a3 service glance] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:36.557621 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 723/1475] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:39:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:39:38.579148 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41524717-0c9c-4f43-aa6b-857441186c49 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:38.579755 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41524717-0c9c-4f43-aa6b-857441186c49 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:38.579755 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41524717-0c9c-4f43-aa6b-857441186c49 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:38.581164 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 753/1476] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:38.587014 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830f72b-659e-444e-8d47-ee4b41265e34 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:38.587477 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830f72b-659e-444e-8d47-ee4b41265e34 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:38.587588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830f72b-659e-444e-8d47-ee4b41265e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:38.656386 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-0830f72b-659e-444e-8d47-ee4b41265e34 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:38.657655 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0830f72b-659e-444e-8d47-ee4b41265e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:38.772796 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 724/1477] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:39:39.048132 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41524717-0c9c-4f43-aa6b-857441186c49 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:39.049798 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-41524717-0c9c-4f43-aa6b-857441186c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:39.184582 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41524717-0c9c-4f43-aa6b-857441186c49 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:39.242927 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:39.287523 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0339a-ce98-4014-a68f-137244112c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:39.288123 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0339a-ce98-4014-a68f-137244112c12 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:39.288399 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0339a-ce98-4014-a68f-137244112c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:39.288697 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0339a-ce98-4014-a68f-137244112c12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:39.289330 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b0339a-ce98-4014-a68f-137244112c12 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:39.291051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: WARNING py.warnings [None req-26b0339a-ce98-4014-a68f-137244112c12 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:39:39.291051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: warnings.warn(msg) Aug 22 20:39:39.291051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: Aug 22 20:39:39.292182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b0339a-ce98-4014-a68f-137244112c12 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:39.311685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 754/1478] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Aug 22 20:39:39 2022] GET /identity/v3/projects => generated 2553 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:39:41.221204 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009de7c-3639-4189-9f27-e20cd6aec663 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:41.221820 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009de7c-3639-4189-9f27-e20cd6aec663 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:41.221820 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009de7c-3639-4189-9f27-e20cd6aec663 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:41.223083 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 725/1479] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:41.228294 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f402cc1-5cb5-4371-89b4-3e1148403c33 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:41.228778 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f402cc1-5cb5-4371-89b4-3e1148403c33 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:41.228896 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f402cc1-5cb5-4371-89b4-3e1148403c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:41.294452 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-5f402cc1-5cb5-4371-89b4-3e1148403c33 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:41.295654 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-5f402cc1-5cb5-4371-89b4-3e1148403c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:41.390253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 755/1480] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:39:41.685045 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009de7c-3639-4189-9f27-e20cd6aec663 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:41.686586 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d009de7c-3639-4189-9f27-e20cd6aec663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:41.696564 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:41.838453 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009de7c-3639-4189-9f27-e20cd6aec663 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:41.917296 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:41.950376 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c733b5-fce6-449d-a9ae-e74b082d3564 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1738f72b4848499cdf0ec6866c3c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:41.950931 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c733b5-fce6-449d-a9ae-e74b082d3564 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:41.951208 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c733b5-fce6-449d-a9ae-e74b082d3564 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:41.951479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c733b5-fce6-449d-a9ae-e74b082d3564 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:41.953123 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-59c733b5-fce6-449d-a9ae-e74b082d3564 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:42.043097 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c733b5-fce6-449d-a9ae-e74b082d3564 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:42.044731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c733b5-fce6-449d-a9ae-e74b082d3564 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:42.063160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 726/1481] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:39:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:39:44.197170 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b480a-358e-480f-9024-5b448f3a67c9 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:44.197756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b480a-358e-480f-9024-5b448f3a67c9 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:44.197756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b480a-358e-480f-9024-5b448f3a67c9 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:44.199081 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 756/1482] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:44.204448 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92326e-9692-482a-bc6b-7a7f355a1ca4 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:44.205001 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92326e-9692-482a-bc6b-7a7f355a1ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:44.205109 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92326e-9692-482a-bc6b-7a7f355a1ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:44.271195 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-fc92326e-9692-482a-bc6b-7a7f355a1ca4 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:44.272428 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-fc92326e-9692-482a-bc6b-7a7f355a1ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:44.318277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:44.368549 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 727/1483] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:39:44.653914 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b480a-358e-480f-9024-5b448f3a67c9 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:44.655461 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-735b480a-358e-480f-9024-5b448f3a67c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:44.679369 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:44.759873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b480a-358e-480f-9024-5b448f3a67c9 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:44.835231 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14408887-e99b-4a8a-85d9-e110d7b9ee9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:44.835833 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14408887-e99b-4a8a-85d9-e110d7b9ee9c service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:44.836108 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14408887-e99b-4a8a-85d9-e110d7b9ee9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:44.836376 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14408887-e99b-4a8a-85d9-e110d7b9ee9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:44.837993 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-14408887-e99b-4a8a-85d9-e110d7b9ee9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:44.913858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:44.949985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14408887-e99b-4a8a-85d9-e110d7b9ee9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:44.951441 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14408887-e99b-4a8a-85d9-e110d7b9ee9c service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:44.969706 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 757/1484] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:39:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:39:46.901185 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3552d3d-2f88-45e4-82c8-a0eeeeba034e None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:46.901750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3552d3d-2f88-45e4-82c8-a0eeeeba034e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:46.901750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3552d3d-2f88-45e4-82c8-a0eeeeba034e None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:46.903055 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 728/1485] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:46.908354 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7a4b1-37be-45e1-9c25-3246b718a82e None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:46.908811 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7a4b1-37be-45e1-9c25-3246b718a82e None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:46.908950 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7a4b1-37be-45e1-9c25-3246b718a82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:46.976418 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-1dc7a4b1-37be-45e1-9c25-3246b718a82e None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:46.977657 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-1dc7a4b1-37be-45e1-9c25-3246b718a82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:47.076612 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 758/1486] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:39:47.378518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3552d3d-2f88-45e4-82c8-a0eeeeba034e None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:47.380129 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b3552d3d-2f88-45e4-82c8-a0eeeeba034e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:47.485852 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3552d3d-2f88-45e4-82c8-a0eeeeba034e None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:47.566405 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:47.569060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3eaba-03ec-4099-82a9-21a0ef110b42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:47.569701 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3eaba-03ec-4099-82a9-21a0ef110b42 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:47.569977 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3eaba-03ec-4099-82a9-21a0ef110b42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:47.570245 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3eaba-03ec-4099-82a9-21a0ef110b42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:47.571866 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d4b3eaba-03ec-4099-82a9-21a0ef110b42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:47.682262 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3eaba-03ec-4099-82a9-21a0ef110b42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:47.683699 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3eaba-03ec-4099-82a9-21a0ef110b42 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:47.701909 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 729/1487] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:39:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:39:49.786753 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f18892-b289-4275-8247-d013321a8e67 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:49.787857 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f18892-b289-4275-8247-d013321a8e67 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:49.788005 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f18892-b289-4275-8247-d013321a8e67 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:49.789402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 759/1488] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:39:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:49.794952 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb8eb1-ada9-494e-8903-fba1cc0d03c3 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:49.795336 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb8eb1-ada9-494e-8903-fba1cc0d03c3 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:49.795439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb8eb1-ada9-494e-8903-fba1cc0d03c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:49.861130 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-06eb8eb1-ada9-494e-8903-fba1cc0d03c3 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:49.862337 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-06eb8eb1-ada9-494e-8903-fba1cc0d03c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:49.914485 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:49.958270 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 730/1489] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:39:50.253097 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f18892-b289-4275-8247-d013321a8e67 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:50.254633 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-86f18892-b289-4275-8247-d013321a8e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:50.290358 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:50.359676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f18892-b289-4275-8247-d013321a8e67 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:50.434908 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a008b1-f3fb-423c-a259-35090c6d6ef7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:50.435510 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a008b1-f3fb-423c-a259-35090c6d6ef7 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:50.435787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a008b1-f3fb-423c-a259-35090c6d6ef7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:50.436056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a008b1-f3fb-423c-a259-35090c6d6ef7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:50.437690 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-31a008b1-f3fb-423c-a259-35090c6d6ef7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:50.516880 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:50.547331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a008b1-f3fb-423c-a259-35090c6d6ef7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:50.548841 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a008b1-f3fb-423c-a259-35090c6d6ef7 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:50.568140 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 760/1490] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:39:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:39:52.982806 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57a8f1-2846-451f-b40a-e4fd37c7e8ea None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:52.983344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57a8f1-2846-451f-b40a-e4fd37c7e8ea None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:52.983344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57a8f1-2846-451f-b40a-e4fd37c7e8ea None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:52.984688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 731/1491] 10.222.0.62 () {54 vars in 927 bytes} [Mon Aug 22 20:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:39:52.989871 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768cd2b-0722-46ff-be79-f004b8af475f None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:52.990281 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768cd2b-0722-46ff-be79-f004b8af475f None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:52.990421 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768cd2b-0722-46ff-be79-f004b8af475f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:53.057763 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-8768cd2b-0722-46ff-be79-f004b8af475f None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:39:53.057763 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-8768cd2b-0722-46ff-be79-f004b8af475f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:53.153333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 761/1492] 10.222.0.62 () {58 vars in 1024 bytes} [Mon Aug 22 20:39:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:39:53.440601 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57a8f1-2846-451f-b40a-e4fd37c7e8ea None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:39:53.442191 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-bd57a8f1-2846-451f-b40a-e4fd37c7e8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:53.544314 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57a8f1-2846-451f-b40a-e4fd37c7e8ea None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:39:53.618085 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b898a-7055-46de-ae10-e2d43fe377c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:39:53.618696 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b898a-7055-46de-ae10-e2d43fe377c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:39:53.618974 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b898a-7055-46de-ae10-e2d43fe377c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:39:53.619246 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b898a-7055-46de-ae10-e2d43fe377c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:39:53.620887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-d91b898a-7055-46de-ae10-e2d43fe377c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:39:53.630176 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:39:53.734677 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b898a-7055-46de-ae10-e2d43fe377c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:39:53.736113 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b898a-7055-46de-ae10-e2d43fe377c5 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:39:53.754598 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 732/1493] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:39:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:40:03.151514 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=82 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:40:03.752356 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=50 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:14.588978 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c333e-3583-4090-a3cf-4b6e93f4919c None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:14.589589 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c333e-3583-4090-a3cf-4b6e93f4919c None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:14.589589 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c333e-3583-4090-a3cf-4b6e93f4919c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:14.664583 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-d56c333e-3583-4090-a3cf-4b6e93f4919c None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:41:14.665921 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-d56c333e-3583-4090-a3cf-4b6e93f4919c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:41:14.761468 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 762/1494] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 22 20:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:41:14.770626 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344207f-722b-4e45-99db-7f741771b094 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:14.777715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344207f-722b-4e45-99db-7f741771b094 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:14.777715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344207f-722b-4e45-99db-7f741771b094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:14.851516 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-9344207f-722b-4e45-99db-7f741771b094 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:41:14.852682 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-9344207f-722b-4e45-99db-7f741771b094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:41:14.948784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 733/1495] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 22 20:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:41:14.953428 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c333e-3583-4090-a3cf-4b6e93f4919c None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:14.955158 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-d56c333e-3583-4090-a3cf-4b6e93f4919c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:41:14.966849 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c333e-3583-4090-a3cf-4b6e93f4919c None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:15.028099 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:15.061664 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfaee8d-2e0b-4027-80fc-e9a15a61ad52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:15.062287 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfaee8d-2e0b-4027-80fc-e9a15a61ad52 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:15.062544 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfaee8d-2e0b-4027-80fc-e9a15a61ad52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:15.062811 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfaee8d-2e0b-4027-80fc-e9a15a61ad52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:15.063446 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfaee8d-2e0b-4027-80fc-e9a15a61ad52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:41:15.063746 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfaee8d-2e0b-4027-80fc-e9a15a61ad52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:15.065216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: WARNING py.warnings [None req-3bfaee8d-2e0b-4027-80fc-e9a15a61ad52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:41:15.065216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: warnings.warn(msg) Aug 22 20:41:15.065216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: Aug 22 20:41:15.066114 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfaee8d-2e0b-4027-80fc-e9a15a61ad52 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:15.077801 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 763/1496] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 22 20:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:41:15.087116 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344207f-722b-4e45-99db-7f741771b094 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:15.096867 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344207f-722b-4e45-99db-7f741771b094 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:15.157566 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:15.191454 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d65d5-ac05-40d6-9f9f-32638fb312de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:15.192046 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d65d5-ac05-40d6-9f9f-32638fb312de admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:15.192321 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d65d5-ac05-40d6-9f9f-32638fb312de admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:15.192589 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d65d5-ac05-40d6-9f9f-32638fb312de admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:15.193431 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d65d5-ac05-40d6-9f9f-32638fb312de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:15.195207 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: WARNING py.warnings [None req-029d65d5-ac05-40d6-9f9f-32638fb312de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:41:15.195207 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: warnings.warn(msg) Aug 22 20:41:15.195207 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: Aug 22 20:41:15.196403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d65d5-ac05-40d6-9f9f-32638fb312de admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:15.325345 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 734/1497] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 22 20:41:15 2022] POST /identity/v3/projects => generated 377 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:41:15.329688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfaee8d-2e0b-4027-80fc-e9a15a61ad52 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:15.332247 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-3bfaee8d-2e0b-4027-80fc-e9a15a61ad52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:41:15.366642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfaee8d-2e0b-4027-80fc-e9a15a61ad52 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:15.461508 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194fd555-d39e-4542-bf2a-425b97180585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:15.462194 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194fd555-d39e-4542-bf2a-425b97180585 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:15.462468 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194fd555-d39e-4542-bf2a-425b97180585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:15.462733 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194fd555-d39e-4542-bf2a-425b97180585 admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:15.463359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194fd555-d39e-4542-bf2a-425b97180585 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:15.464371 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: WARNING py.warnings [None req-194fd555-d39e-4542-bf2a-425b97180585 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:41:15.464371 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: warnings.warn(msg) Aug 22 20:41:15.464371 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: Aug 22 20:41:15.465761 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194fd555-d39e-4542-bf2a-425b97180585 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:15.576012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 764/1498] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 22 20:41:15 2022] POST /identity/v3/users => generated 289 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:41:15.580941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d65d5-ac05-40d6-9f9f-32638fb312de admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:15.582467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-029d65d5-ac05-40d6-9f9f-32638fb312de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:41:15.644281 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d65d5-ac05-40d6-9f9f-32638fb312de admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:15.728383 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:15.739439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668c919-7f7e-4018-a1be-eccba6f41ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:15.745738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668c919-7f7e-4018-a1be-eccba6f41ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:15.745738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668c919-7f7e-4018-a1be-eccba6f41ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:15.745738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668c919-7f7e-4018-a1be-eccba6f41ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:15.745738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668c919-7f7e-4018-a1be-eccba6f41ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:15.745738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: WARNING py.warnings [None req-a668c919-7f7e-4018-a1be-eccba6f41ff1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:41:15.745738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: warnings.warn(msg) Aug 22 20:41:15.745738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: Aug 22 20:41:15.746335 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668c919-7f7e-4018-a1be-eccba6f41ff1 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:15.756750 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 735/1499] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 22 20:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:41:15.760990 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194fd555-d39e-4542-bf2a-425b97180585 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:15.762518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-194fd555-d39e-4542-bf2a-425b97180585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:41:15.774493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194fd555-d39e-4542-bf2a-425b97180585 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:15.800942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:15.870879 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a51472-4d57-494e-a1fe-5553d246f9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:15.871484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a51472-4d57-494e-a1fe-5553d246f9a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:15.871775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a51472-4d57-494e-a1fe-5553d246f9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:15.872046 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a51472-4d57-494e-a1fe-5553d246f9a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:15.872703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a51472-4d57-494e-a1fe-5553d246f9a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:15.873716 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: WARNING py.warnings [None req-a4a51472-4d57-494e-a1fe-5553d246f9a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:41:15.873716 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: warnings.warn(msg) Aug 22 20:41:15.873716 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: Aug 22 20:41:15.874600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a51472-4d57-494e-a1fe-5553d246f9a3 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:15.887327 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 765/1500] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 22 20:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:41:15.891563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668c919-7f7e-4018-a1be-eccba6f41ff1 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:15.893246 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-a668c919-7f7e-4018-a1be-eccba6f41ff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:41:15.926503 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668c919-7f7e-4018-a1be-eccba6f41ff1 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:16.020391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c15c57-5530-46bf-8e71-e2004f52e1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:16.021007 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c15c57-5530-46bf-8e71-e2004f52e1b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:16.021290 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c15c57-5530-46bf-8e71-e2004f52e1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:16.021568 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c15c57-5530-46bf-8e71-e2004f52e1b8 admin admin] PATH_INFO: `/v3/projects/9bbbc9cad559451cbadb99deab918412/users/13238b8ce7ed490694afb73c4a88b1ca/roles/028945f544094c26933c8ef60a480e9a` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:16.043603 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c15c57-5530-46bf-8e71-e2004f52e1b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bbbc9cad559451cbadb99deab918412, user_id=13238b8ce7ed490694afb73c4a88b1ca, role_id=028945f544094c26933c8ef60a480e9a)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:16.044678 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: WARNING py.warnings [None req-a7c15c57-5530-46bf-8e71-e2004f52e1b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:41:16.044678 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: warnings.warn(msg) Aug 22 20:41:16.044678 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: Aug 22 20:41:16.046887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c15c57-5530-46bf-8e71-e2004f52e1b8 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:16.150370 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 736/1501] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 22 20:41:15 2022] PUT /identity/v3/projects/9bbbc9cad559451cbadb99deab918412/users/13238b8ce7ed490694afb73c4a88b1ca/roles/028945f544094c26933c8ef60a480e9a => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:41:16.162918 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b5c6d-c0fb-44b4-9023-b8c0d2f1c407 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:16.163206 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b5c6d-c0fb-44b4-9023-b8c0d2f1c407 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:16.163482 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b5c6d-c0fb-44b4-9023-b8c0d2f1c407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:16.220652 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-243b5c6d-c0fb-44b4-9023-b8c0d2f1c407 None None] MFA Rules not processed for user `13238b8ce7ed490694afb73c4a88b1ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:41:16.221939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-243b5c6d-c0fb-44b4-9023-b8c0d2f1c407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:41:16.297207 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 766/1502] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 22 20:41:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:41:16.310307 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34206f-2bb5-41de-8528-59de1670e13c None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:16.310593 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34206f-2bb5-41de-8528-59de1670e13c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:16.310868 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34206f-2bb5-41de-8528-59de1670e13c None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:16.312189 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 737/1503] 10.222.0.62 () {54 vars in 964 bytes} [Mon Aug 22 20:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:41:16.317556 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb064de-9b32-47b4-b391-40ea5fb9011e None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:16.317836 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb064de-9b32-47b4-b391-40ea5fb9011e None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:16.318107 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb064de-9b32-47b4-b391-40ea5fb9011e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:16.348806 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:16.394561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-bfb064de-9b32-47b4-b391-40ea5fb9011e None None] MFA Rules not processed for user `893e204cfff74570b3226b2e8c47df57`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:41:16.395773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-bfb064de-9b32-47b4-b391-40ea5fb9011e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:41:16.472400 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 767/1504] 10.222.0.62 () {58 vars in 1061 bytes} [Mon Aug 22 20:41:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:41:16.480248 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34206f-2bb5-41de-8528-59de1670e13c None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:16.482856 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-dc34206f-2bb5-41de-8528-59de1670e13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:41:16.537694 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:16.591373 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34206f-2bb5-41de-8528-59de1670e13c None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:16.670073 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbde27-1e45-4ae4-b249-12d6d6750b1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '893e204cfff74570b3226b2e8c47df57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:16.670970 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbde27-1e45-4ae4-b249-12d6d6750b1f service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:16.671393 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbde27-1e45-4ae4-b249-12d6d6750b1f service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:16.671673 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbde27-1e45-4ae4-b249-12d6d6750b1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:16.674031 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-70fbde27-1e45-4ae4-b249-12d6d6750b1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:41:16.774067 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fbde27-1e45-4ae4-b249-12d6d6750b1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:16.779105 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fbde27-1e45-4ae4-b249-12d6d6750b1f service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:16.779105 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:16.793721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 738/1505] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:41:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:41:16.840304 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5f3cb-618a-40a1-8656-7b04ee00f238 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:16.840749 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5f3cb-618a-40a1-8656-7b04ee00f238 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:16.840903 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5f3cb-618a-40a1-8656-7b04ee00f238 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:16.842251 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 768/1506] 10.222.0.62 () {52 vars in 830 bytes} [Mon Aug 22 20:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:41:16.846188 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbde27-1e45-4ae4-b249-12d6d6750b1f service cinder] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:16.847400 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-70fbde27-1e45-4ae4-b249-12d6d6750b1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:41:16.948608 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbde27-1e45-4ae4-b249-12d6d6750b1f service cinder] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:17.041486 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8053e-9d51-4e4b-acd2-fbc1da2fac90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:17.042111 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8053e-9d51-4e4b-acd2-fbc1da2fac90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:17.042391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8053e-9d51-4e4b-acd2-fbc1da2fac90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:17.042657 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8053e-9d51-4e4b-acd2-fbc1da2fac90 admin admin] PATH_INFO: `/v3/users/13238b8ce7ed490694afb73c4a88b1ca` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:17.055845 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8053e-9d51-4e4b-acd2-fbc1da2fac90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13238b8ce7ed490694afb73c4a88b1ca)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:17.056904 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: WARNING py.warnings [None req-58f8053e-9d51-4e4b-acd2-fbc1da2fac90 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:41:17.056904 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: warnings.warn(msg) Aug 22 20:41:17.056904 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: Aug 22 20:41:17.058130 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8053e-9d51-4e4b-acd2-fbc1da2fac90 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:17.067766 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:17.294728 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-58f8053e-9d51-4e4b-acd2-fbc1da2fac90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13238b8ce7ed490694afb73c4a88b1ca'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:41:17.295540 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-58f8053e-9d51-4e4b-acd2-fbc1da2fac90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13238b8ce7ed490694afb73c4a88b1ca'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:41:17.295962 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-58f8053e-9d51-4e4b-acd2-fbc1da2fac90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13238b8ce7ed490694afb73c4a88b1ca'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:41:17.310128 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-58f8053e-9d51-4e4b-acd2-fbc1da2fac90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13238b8ce7ed490694afb73c4a88b1ca'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:41:17.332864 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-58f8053e-9d51-4e4b-acd2-fbc1da2fac90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13238b8ce7ed490694afb73c4a88b1ca'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:41:17.399947 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 739/1507] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 22 20:41:16 2022] DELETE /identity/v3/users/13238b8ce7ed490694afb73c4a88b1ca => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:41:17.404420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c3810-3998-4ad3-a21e-186788a744cd None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:17.404729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c3810-3998-4ad3-a21e-186788a744cd None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:17.408940 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c3810-3998-4ad3-a21e-186788a744cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:17.462853 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-858c3810-3998-4ad3-a21e-186788a744cd None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:41:17.464046 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-858c3810-3998-4ad3-a21e-186788a744cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:41:17.539186 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:17.552046 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 769/1508] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 22 20:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:41:17.561579 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8053e-9d51-4e4b-acd2-fbc1da2fac90 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:17.562817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-58f8053e-9d51-4e4b-acd2-fbc1da2fac90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:41:17.663811 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8053e-9d51-4e4b-acd2-fbc1da2fac90 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:17.721311 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:17.740566 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e876c-de9f-44cd-a88b-ce2db7a85e0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:17.741199 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e876c-de9f-44cd-a88b-ce2db7a85e0a service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:17.741477 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e876c-de9f-44cd-a88b-ce2db7a85e0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:17.741746 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e876c-de9f-44cd-a88b-ce2db7a85e0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:17.743349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-624e876c-de9f-44cd-a88b-ce2db7a85e0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:41:18.069156 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e876c-de9f-44cd-a88b-ce2db7a85e0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:18.070598 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e876c-de9f-44cd-a88b-ce2db7a85e0a service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:18.089100 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 740/1509] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:41:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:41:18.539443 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c3810-3998-4ad3-a21e-186788a744cd None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:41:18.540794 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-858c3810-3998-4ad3-a21e-186788a744cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:41:18.553490 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c3810-3998-4ad3-a21e-186788a744cd None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:41:18.650113 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96361c4f-43ef-4d60-be4c-4b3dbed4299a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:41:18.650741 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96361c4f-43ef-4d60-be4c-4b3dbed4299a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:41:18.651020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96361c4f-43ef-4d60-be4c-4b3dbed4299a admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:41:18.651291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96361c4f-43ef-4d60-be4c-4b3dbed4299a admin admin] PATH_INFO: `/v3/projects/9bbbc9cad559451cbadb99deab918412` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:41:18.661740 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96361c4f-43ef-4d60-be4c-4b3dbed4299a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bbbc9cad559451cbadb99deab918412)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:41:18.662762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: WARNING py.warnings [None req-96361c4f-43ef-4d60-be4c-4b3dbed4299a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:41:18.662762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: warnings.warn(msg) Aug 22 20:41:18.662762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: Aug 22 20:41:18.663958 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96361c4f-43ef-4d60-be4c-4b3dbed4299a admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:41:18.776357 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-96361c4f-43ef-4d60-be4c-4b3dbed4299a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bbbc9cad559451cbadb99deab918412', 'request_id': 'req-96361c4f-43ef-4d60-be4c-4b3dbed4299a'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:41:18.846616 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-96361c4f-43ef-4d60-be4c-4b3dbed4299a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bbbc9cad559451cbadb99deab918412', 'request_id': 'req-96361c4f-43ef-4d60-be4c-4b3dbed4299a'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:41:18.860563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-96361c4f-43ef-4d60-be4c-4b3dbed4299a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bbbc9cad559451cbadb99deab918412', 'request_id': 'req-96361c4f-43ef-4d60-be4c-4b3dbed4299a'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:41:18.884930 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-96361c4f-43ef-4d60-be4c-4b3dbed4299a admin admin] The token cache is being invalidate because project 9bbbc9cad559451cbadb99deab918412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81637) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:41:18.885246 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-96361c4f-43ef-4d60-be4c-4b3dbed4299a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:41:18.885678 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-96361c4f-43ef-4d60-be4c-4b3dbed4299a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:41:18.887052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 770/1510] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 22 20:41:18 2022] DELETE /identity/v3/projects/9bbbc9cad559451cbadb99deab918412 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:41:28.086700 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=62 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:41:28.882891 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:36.459910 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2be7e-cd39-45f9-8293-b109b1916fa3 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:36.460874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2be7e-cd39-45f9-8293-b109b1916fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:36.460874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2be7e-cd39-45f9-8293-b109b1916fa3 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:36.462473 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 741/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:42:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:42:36.467732 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e8c70-d163-4988-9fa2-eece057198a0 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:36.468249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e8c70-d163-4988-9fa2-eece057198a0 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:36.468361 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e8c70-d163-4988-9fa2-eece057198a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:36.579589 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-4a3e8c70-d163-4988-9fa2-eece057198a0 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:36.580845 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-4a3e8c70-d163-4988-9fa2-eece057198a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:36.702600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 771/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:42:36.862875 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2be7e-cd39-45f9-8293-b109b1916fa3 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:36.875889 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-96a2be7e-cd39-45f9-8293-b109b1916fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:37.011906 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2be7e-cd39-45f9-8293-b109b1916fa3 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:37.020385 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c11bc-3af7-4b3c-912d-bdc34cdde3f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1738f72b4848499cdf0ec6866c3c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:37.021057 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c11bc-3af7-4b3c-912d-bdc34cdde3f6 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:37.021328 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c11bc-3af7-4b3c-912d-bdc34cdde3f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:37.021593 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c11bc-3af7-4b3c-912d-bdc34cdde3f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:37.031210 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c11bc-3af7-4b3c-912d-bdc34cdde3f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:37.032913 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c11bc-3af7-4b3c-912d-bdc34cdde3f6 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:37.044488 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 742/1513] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:42:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:42:37.933914 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac8bea-a254-4a5c-8c13-89c5c5ac84d1 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:37.934496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac8bea-a254-4a5c-8c13-89c5c5ac84d1 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:37.934496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac8bea-a254-4a5c-8c13-89c5c5ac84d1 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:37.935859 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 772/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:42:37.941314 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd340467-1757-46ed-a6a7-c46f90528267 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:37.942609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd340467-1757-46ed-a6a7-c46f90528267 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:37.942609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd340467-1757-46ed-a6a7-c46f90528267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:37.964451 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-dd340467-1757-46ed-a6a7-c46f90528267 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:37.965729 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-dd340467-1757-46ed-a6a7-c46f90528267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:37.974681 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 743/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:42:38.137517 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac8bea-a254-4a5c-8c13-89c5c5ac84d1 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:38.154102 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac8bea-a254-4a5c-8c13-89c5c5ac84d1 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:38.162804 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bcffe2-4172-410c-af12-77bc690313e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1738f72b4848499cdf0ec6866c3c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:38.163775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bcffe2-4172-410c-af12-77bc690313e3 service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:38.164500 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bcffe2-4172-410c-af12-77bc690313e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:38.164980 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bcffe2-4172-410c-af12-77bc690313e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:38.174272 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bcffe2-4172-410c-af12-77bc690313e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:38.175983 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bcffe2-4172-410c-af12-77bc690313e3 service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:38.188683 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 773/1516] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:42:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:42:41.083217 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8301395-b75d-4972-85c0-767e75598056 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:41.083217 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8301395-b75d-4972-85c0-767e75598056 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:41.083890 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8301395-b75d-4972-85c0-767e75598056 None None] PATH_INFO: `/v3` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:41.084756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 744/1517] 10.222.0.75 () {54 vars in 925 bytes} [Mon Aug 22 20:42:41 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:42:41.091655 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090449a-805d-41bb-b313-d230a1e9dd60 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:41.092242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090449a-805d-41bb-b313-d230a1e9dd60 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:41.092242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090449a-805d-41bb-b313-d230a1e9dd60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:41.167715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-2090449a-805d-41bb-b313-d230a1e9dd60 None None] MFA Rules not processed for user `d3fdb2336b8b4f7c9b710b224a8594a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:41.169040 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-2090449a-805d-41bb-b313-d230a1e9dd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:41.190527 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:41.254330 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 774/1518] 10.222.0.75 () {58 vars in 1015 bytes} [Mon Aug 22 20:42:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:42:47.958261 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=56 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:42:49.455162 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004774f-4ce0-4c1d-a846-9acd4f443979 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:49.455843 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004774f-4ce0-4c1d-a846-9acd4f443979 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:49.455843 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004774f-4ce0-4c1d-a846-9acd4f443979 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:49.457618 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 745/1519] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:42:49.462412 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34012bcb-d108-4ba7-b2cc-033599b3d1e9 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:49.462868 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34012bcb-d108-4ba7-b2cc-033599b3d1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:49.462979 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34012bcb-d108-4ba7-b2cc-033599b3d1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:49.482263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-34012bcb-d108-4ba7-b2cc-033599b3d1e9 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:49.483710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-34012bcb-d108-4ba7-b2cc-033599b3d1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:49.491339 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 775/1520] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:42:49.647367 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004774f-4ce0-4c1d-a846-9acd4f443979 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:49.661796 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004774f-4ce0-4c1d-a846-9acd4f443979 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:49.667696 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c6e5c-bf25-43d9-badf-cf049501c405 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1738f72b4848499cdf0ec6866c3c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:49.668284 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c6e5c-bf25-43d9-badf-cf049501c405 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:49.668561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c6e5c-bf25-43d9-badf-cf049501c405 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:49.668869 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c6e5c-bf25-43d9-badf-cf049501c405 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:49.677053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c6e5c-bf25-43d9-badf-cf049501c405 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:49.678717 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c6e5c-bf25-43d9-badf-cf049501c405 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:49.688027 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 746/1521] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:42:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:42:50.514757 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2e174-f452-40a9-adc9-fc689e6e4834 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:50.515337 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2e174-f452-40a9-adc9-fc689e6e4834 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:50.515337 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2e174-f452-40a9-adc9-fc689e6e4834 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:50.516685 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 776/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 20:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:42:50.521585 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8167b7-ad78-4ae2-9d33-32dad247d861 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:50.522005 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8167b7-ad78-4ae2-9d33-32dad247d861 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:50.522205 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8167b7-ad78-4ae2-9d33-32dad247d861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:50.529001 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69260cc9-aee8-4a05-ba3b-fdb5d888e05a None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:50.529356 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69260cc9-aee8-4a05-ba3b-fdb5d888e05a None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:50.529723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69260cc9-aee8-4a05-ba3b-fdb5d888e05a None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:50.530993 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 777/1523] 10.222.0.62 () {54 vars in 961 bytes} [Mon Aug 22 20:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:42:50.536363 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74b663-3250-48c9-894d-10e8a4c99284 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:50.536642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74b663-3250-48c9-894d-10e8a4c99284 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:50.536943 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74b663-3250-48c9-894d-10e8a4c99284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:50.542688 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-cb8167b7-ad78-4ae2-9d33-32dad247d861 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:50.543877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-cb8167b7-ad78-4ae2-9d33-32dad247d861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:50.552350 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 747/1524] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 20:42:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:42:50.556615 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-bb74b663-3250-48c9-894d-10e8a4c99284 None None] MFA Rules not processed for user `d3fdb2336b8b4f7c9b710b224a8594a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:50.557843 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-bb74b663-3250-48c9-894d-10e8a4c99284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:50.571874 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 778/1525] 10.222.0.62 () {58 vars in 1058 bytes} [Mon Aug 22 20:42:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:42:50.579356 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8167b7-ad78-4ae2-9d33-32dad247d861 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:50.590667 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8167b7-ad78-4ae2-9d33-32dad247d861 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:50.595601 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc438e88-6c5f-4f63-85e6-ad2f6eaa5b52 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3fdb2336b8b4f7c9b710b224a8594a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:50.596190 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc438e88-6c5f-4f63-85e6-ad2f6eaa5b52 service placement] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:50.596466 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc438e88-6c5f-4f63-85e6-ad2f6eaa5b52 service placement] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:50.597271 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc438e88-6c5f-4f63-85e6-ad2f6eaa5b52 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:50.605357 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc438e88-6c5f-4f63-85e6-ad2f6eaa5b52 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:50.606936 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc438e88-6c5f-4f63-85e6-ad2f6eaa5b52 service placement] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:50.616776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 748/1526] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:42:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:42:50.703439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74b663-3250-48c9-894d-10e8a4c99284 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:50.716302 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74b663-3250-48c9-894d-10e8a4c99284 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:50.721887 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae048ae6-f2ce-46f0-a59f-8d630eae56a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1738f72b4848499cdf0ec6866c3c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:50.722525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae048ae6-f2ce-46f0-a59f-8d630eae56a8 service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:50.722803 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae048ae6-f2ce-46f0-a59f-8d630eae56a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:50.723071 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae048ae6-f2ce-46f0-a59f-8d630eae56a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:50.731322 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae048ae6-f2ce-46f0-a59f-8d630eae56a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:50.732923 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae048ae6-f2ce-46f0-a59f-8d630eae56a8 service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:50.743405 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 779/1527] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:42:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:42:54.749990 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0895d-9cca-4bf3-b432-0fe00874cdc9 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:54.750563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0895d-9cca-4bf3-b432-0fe00874cdc9 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:54.750563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0895d-9cca-4bf3-b432-0fe00874cdc9 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:54.751851 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 749/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:42:54.758323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d86e2-b0f2-4cdc-8297-940b65a3497d None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:54.758734 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d86e2-b0f2-4cdc-8297-940b65a3497d None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:54.758868 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d86e2-b0f2-4cdc-8297-940b65a3497d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:54.783146 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-109d86e2-b0f2-4cdc-8297-940b65a3497d None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:54.784448 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-109d86e2-b0f2-4cdc-8297-940b65a3497d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:54.792496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 780/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:42:55.079443 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0895d-9cca-4bf3-b432-0fe00874cdc9 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:55.081911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-22f0895d-9cca-4bf3-b432-0fe00874cdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:55.159563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0895d-9cca-4bf3-b432-0fe00874cdc9 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:55.163417 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e0b89c-7694-48aa-b5b5-12875f67babe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:55.164014 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0b89c-7694-48aa-b5b5-12875f67babe service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:55.164291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0b89c-7694-48aa-b5b5-12875f67babe service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:55.164560 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e0b89c-7694-48aa-b5b5-12875f67babe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:55.173453 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0b89c-7694-48aa-b5b5-12875f67babe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:55.174937 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e0b89c-7694-48aa-b5b5-12875f67babe service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:55.184093 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 750/1530] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:42:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:42:57.085318 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304df8e-b9d9-4b65-9be5-1a510846caff None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:57.085892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304df8e-b9d9-4b65-9be5-1a510846caff None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:57.085892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304df8e-b9d9-4b65-9be5-1a510846caff None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:57.087235 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 781/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:42:57.092322 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e11ca-27b2-4569-85d1-257962835e24 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:57.092732 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e11ca-27b2-4569-85d1-257962835e24 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:57.092890 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e11ca-27b2-4569-85d1-257962835e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:57.111759 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-021e11ca-27b2-4569-85d1-257962835e24 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:42:57.113254 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-021e11ca-27b2-4569-85d1-257962835e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:42:57.120888 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 751/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:42:57.405710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304df8e-b9d9-4b65-9be5-1a510846caff None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:42:57.417232 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304df8e-b9d9-4b65-9be5-1a510846caff None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:42:57.420827 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de010d-363f-4acb-be05-5b70f92a92c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:42:57.426825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de010d-363f-4acb-be05-5b70f92a92c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:42:57.426825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de010d-363f-4acb-be05-5b70f92a92c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:42:57.426825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de010d-363f-4acb-be05-5b70f92a92c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:42:57.432311 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de010d-363f-4acb-be05-5b70f92a92c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:42:57.433782 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66de010d-363f-4acb-be05-5b70f92a92c4 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:42:57.444011 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 782/1533] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:42:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:43:00.903205 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f17368-04a2-4477-bf92-9d7338cf1d29 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:00.903809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f17368-04a2-4477-bf92-9d7338cf1d29 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:00.903809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f17368-04a2-4477-bf92-9d7338cf1d29 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:00.905118 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 752/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:00.911027 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3258243-f96a-4e60-b425-3deba2cc6be8 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:00.911468 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3258243-f96a-4e60-b425-3deba2cc6be8 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:00.911569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3258243-f96a-4e60-b425-3deba2cc6be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:00.931048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-b3258243-f96a-4e60-b425-3deba2cc6be8 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:00.932251 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-b3258243-f96a-4e60-b425-3deba2cc6be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:00.939988 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 783/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:43:01.499917 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f17368-04a2-4477-bf92-9d7338cf1d29 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:43:01.501603 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-92f17368-04a2-4477-bf92-9d7338cf1d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:01.580428 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f17368-04a2-4477-bf92-9d7338cf1d29 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:43:01.584614 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7d436-d387-453a-805f-b54f48986b2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '893e204cfff74570b3226b2e8c47df57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:43:01.585239 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7d436-d387-453a-805f-b54f48986b2f service cinder] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:01.585517 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7d436-d387-453a-805f-b54f48986b2f service cinder] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:01.585796 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7d436-d387-453a-805f-b54f48986b2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:01.597053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7d436-d387-453a-805f-b54f48986b2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:43:01.598892 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7d436-d387-453a-805f-b54f48986b2f service cinder] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:43:01.608262 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 753/1536] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:43:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:43:03.530731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d2ecc-aaf1-4788-8461-89eaadfdc2be None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:03.531237 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d2ecc-aaf1-4788-8461-89eaadfdc2be None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:03.531353 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d2ecc-aaf1-4788-8461-89eaadfdc2be None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:03.532756 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 784/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 20:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:43:03.538599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f073f-2481-4988-b9da-1cb83226d02c None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:03.539031 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f073f-2481-4988-b9da-1cb83226d02c None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:03.539142 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f073f-2481-4988-b9da-1cb83226d02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:03.558780 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-859f073f-2481-4988-b9da-1cb83226d02c None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:43:03.559982 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-859f073f-2481-4988-b9da-1cb83226d02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:03.568583 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 754/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 20:43:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:43:04.129476 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d2ecc-aaf1-4788-8461-89eaadfdc2be None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:43:04.131148 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-ac1d2ecc-aaf1-4788-8461-89eaadfdc2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:43:04.144179 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d2ecc-aaf1-4788-8461-89eaadfdc2be None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:43:04.147655 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f32c75-1559-4307-b894-9549596b4099 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '893e204cfff74570b3226b2e8c47df57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:43:04.148242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f32c75-1559-4307-b894-9549596b4099 service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:43:04.148516 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f32c75-1559-4307-b894-9549596b4099 service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:43:04.148818 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f32c75-1559-4307-b894-9549596b4099 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:43:04.157791 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f32c75-1559-4307-b894-9549596b4099 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:43:04.159354 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f32c75-1559-4307-b894-9549596b4099 service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:43:04.168825 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 785/1539] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:43:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:43:13.553079 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=91 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:43:14.164839 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=53 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:44:24.175022 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bf481-c8d5-44d0-9c52-d1d47f9c9bdc None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:24.175635 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bf481-c8d5-44d0-9c52-d1d47f9c9bdc None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:24.175635 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bf481-c8d5-44d0-9c52-d1d47f9c9bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:24.194575 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-f07bf481-c8d5-44d0-9c52-d1d47f9c9bdc None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:24.195780 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f07bf481-c8d5-44d0-9c52-d1d47f9c9bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:24.204022 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 755/1540] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 22 20:44:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:24.204433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef471c-0b76-40f1-ad67-cfcd40997c3d None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:24.204924 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef471c-0b76-40f1-ad67-cfcd40997c3d None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:24.205075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef471c-0b76-40f1-ad67-cfcd40997c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:24.211797 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da018495-2c24-4efa-b57c-9ac2ff3cc8df None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:24.212091 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da018495-2c24-4efa-b57c-9ac2ff3cc8df None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:24.212343 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da018495-2c24-4efa-b57c-9ac2ff3cc8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:24.225010 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-d1ef471c-0b76-40f1-ad67-cfcd40997c3d None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:24.226210 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-d1ef471c-0b76-40f1-ad67-cfcd40997c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:24.233348 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-da018495-2c24-4efa-b57c-9ac2ff3cc8df None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:24.234235 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 786/1541] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 22 20:44:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:44:24.235365 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-da018495-2c24-4efa-b57c-9ac2ff3cc8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:24.242262 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76d832-e63a-4512-bb8f-1ccc21029bac None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:24.242547 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76d832-e63a-4512-bb8f-1ccc21029bac None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:24.242820 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76d832-e63a-4512-bb8f-1ccc21029bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:24.243434 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 756/1542] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 22 20:44:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:44:24.247581 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da018495-2c24-4efa-b57c-9ac2ff3cc8df None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:24.256861 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da018495-2c24-4efa-b57c-9ac2ff3cc8df None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:24.262329 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8318c5b-2b76-4a5b-9d71-a38f4102685b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:24.262579 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-8d76d832-e63a-4512-bb8f-1ccc21029bac None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:24.262918 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8318c5b-2b76-4a5b-9d71-a38f4102685b admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:24.263191 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8318c5b-2b76-4a5b-9d71-a38f4102685b admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:24.263459 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8318c5b-2b76-4a5b-9d71-a38f4102685b admin admin] PATH_INFO: `/v3/domains` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:24.264707 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8318c5b-2b76-4a5b-9d71-a38f4102685b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81638) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:44:24.264837 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-8d76d832-e63a-4512-bb8f-1ccc21029bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:24.266306 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8318c5b-2b76-4a5b-9d71-a38f4102685b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:24.267518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: WARNING py.warnings [None req-b8318c5b-2b76-4a5b-9d71-a38f4102685b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:44:24.267518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: warnings.warn(msg) Aug 22 20:44:24.267518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: Aug 22 20:44:24.268400 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8318c5b-2b76-4a5b-9d71-a38f4102685b admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:24.272666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 787/1543] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 22 20:44:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:44:24.277159 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76d832-e63a-4512-bb8f-1ccc21029bac None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:24.287642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 757/1544] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 22 20:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 20:44:24.287809 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76d832-e63a-4512-bb8f-1ccc21029bac None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:24.289506 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8318c5b-2b76-4a5b-9d71-a38f4102685b admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:24.292676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9d791-2dd5-4f8a-981d-54f243de2772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:24.293297 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9d791-2dd5-4f8a-981d-54f243de2772 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:24.293575 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9d791-2dd5-4f8a-981d-54f243de2772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:24.293847 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c9d791-2dd5-4f8a-981d-54f243de2772 admin admin] PATH_INFO: `/v3/domains` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:24.294488 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c9d791-2dd5-4f8a-981d-54f243de2772 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81637) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 20:44:24.294810 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c9d791-2dd5-4f8a-981d-54f243de2772 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:24.296397 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c9d791-2dd5-4f8a-981d-54f243de2772 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:24.299103 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8318c5b-2b76-4a5b-9d71-a38f4102685b admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:24.303557 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9c643-d8c2-48b4-96cb-016389c0b740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:24.304138 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9c643-d8c2-48b4-96cb-016389c0b740 admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:24.304411 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9c643-d8c2-48b4-96cb-016389c0b740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:24.304703 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9c643-d8c2-48b4-96cb-016389c0b740 admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:24.305315 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9c643-d8c2-48b4-96cb-016389c0b740 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:24.307185 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9c643-d8c2-48b4-96cb-016389c0b740 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:24.308157 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 788/1545] 10.222.0.62 () {58 vars in 1153 bytes} [Mon Aug 22 20:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 20:44:24.316637 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9d791-2dd5-4f8a-981d-54f243de2772 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:24.328054 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c9d791-2dd5-4f8a-981d-54f243de2772 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:24.332790 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bbb6e-67eb-457b-88af-cdc0e38ee367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:24.333427 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bbb6e-67eb-457b-88af-cdc0e38ee367 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:24.333656 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bbb6e-67eb-457b-88af-cdc0e38ee367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:24.333935 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bbb6e-67eb-457b-88af-cdc0e38ee367 admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:24.334556 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329bbb6e-67eb-457b-88af-cdc0e38ee367 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:24.335569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: WARNING py.warnings [None req-329bbb6e-67eb-457b-88af-cdc0e38ee367 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:44:24.335569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: warnings.warn(msg) Aug 22 20:44:24.335569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: Aug 22 20:44:24.336781 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329bbb6e-67eb-457b-88af-cdc0e38ee367 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:24.429198 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 758/1546] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 22 20:44:24 2022] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:44:24.433581 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9c643-d8c2-48b4-96cb-016389c0b740 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:24.458410 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 789/1547] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 22 20:44:24 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:44:24.462889 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bbb6e-67eb-457b-88af-cdc0e38ee367 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:24.500476 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9c643-d8c2-48b4-96cb-016389c0b740 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:24.525211 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bbb6e-67eb-457b-88af-cdc0e38ee367 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:24.530068 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be3cc1-809b-4efc-8a97-49e6615d5a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:24.530666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be3cc1-809b-4efc-8a97-49e6615d5a8c admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:24.530942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be3cc1-809b-4efc-8a97-49e6615d5a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:24.531209 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be3cc1-809b-4efc-8a97-49e6615d5a8c admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:24.532081 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be3cc1-809b-4efc-8a97-49e6615d5a8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:24.534010 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be3cc1-809b-4efc-8a97-49e6615d5a8c admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:24.558204 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a79582-5497-4194-924b-91763898523e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:24.558808 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a79582-5497-4194-924b-91763898523e admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:24.559086 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a79582-5497-4194-924b-91763898523e admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:24.559357 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a79582-5497-4194-924b-91763898523e admin admin] PATH_INFO: `/v3/users` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:24.559977 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a79582-5497-4194-924b-91763898523e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:24.561761 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: WARNING py.warnings [None req-a2a79582-5497-4194-924b-91763898523e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:44:24.561761 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: warnings.warn(msg) Aug 22 20:44:24.561761 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: Aug 22 20:44:24.563023 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a79582-5497-4194-924b-91763898523e admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:24.627856 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 790/1548] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 22 20:44:24 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:44:24.631506 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be3cc1-809b-4efc-8a97-49e6615d5a8c admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:24.642482 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be3cc1-809b-4efc-8a97-49e6615d5a8c admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:24.647133 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efae82-ab39-485f-a819-0479ad7764b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:24.647724 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efae82-ab39-485f-a819-0479ad7764b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:24.648004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efae82-ab39-485f-a819-0479ad7764b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:24.648278 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efae82-ab39-485f-a819-0479ad7764b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:24.648945 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5efae82-ab39-485f-a819-0479ad7764b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:24.649894 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 759/1549] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 22 20:44:24 2022] POST /identity/v3/users => generated 289 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:44:24.651106 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5efae82-ab39-485f-a819-0479ad7764b9 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:24.654400 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a79582-5497-4194-924b-91763898523e admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:24.661710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 791/1550] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 22 20:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:44:24.665459 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efae82-ab39-485f-a819-0479ad7764b9 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:24.666775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a79582-5497-4194-924b-91763898523e admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:24.671415 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8475236-cb86-464f-8b78-1304a401f231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:24.672025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8475236-cb86-464f-8b78-1304a401f231 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:24.672303 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8475236-cb86-464f-8b78-1304a401f231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:24.672572 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8475236-cb86-464f-8b78-1304a401f231 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:24.673251 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8475236-cb86-464f-8b78-1304a401f231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:24.674853 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8475236-cb86-464f-8b78-1304a401f231 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:24.675640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efae82-ab39-485f-a819-0479ad7764b9 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:24.680341 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ef9bd-6c51-4d4b-bd62-9d68c7a6c484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:24.680889 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ef9bd-6c51-4d4b-bd62-9d68c7a6c484 admin admin] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:24.681172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ef9bd-6c51-4d4b-bd62-9d68c7a6c484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:24.681444 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ef9bd-6c51-4d4b-bd62-9d68c7a6c484 admin admin] PATH_INFO: `/v3/roles` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:24.682072 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ef9bd-6c51-4d4b-bd62-9d68c7a6c484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:24.683645 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ef9bd-6c51-4d4b-bd62-9d68c7a6c484 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:24.685108 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 760/1551] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 22 20:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:44:24.690004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8475236-cb86-464f-8b78-1304a401f231 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:24.696138 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 792/1552] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 22 20:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 20:44:24.699667 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ef9bd-6c51-4d4b-bd62-9d68c7a6c484 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:24.700839 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8475236-cb86-464f-8b78-1304a401f231 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:24.706303 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd3ce3-b630-4339-94c1-4bad3915e342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:24.707012 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd3ce3-b630-4339-94c1-4bad3915e342 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:24.707172 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd3ce3-b630-4339-94c1-4bad3915e342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:24.707448 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd3ce3-b630-4339-94c1-4bad3915e342 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:24.708088 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd3ce3-b630-4339-94c1-4bad3915e342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:24.709778 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd3ce3-b630-4339-94c1-4bad3915e342 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:24.710424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ef9bd-6c51-4d4b-bd62-9d68c7a6c484 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:24.715380 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af2b71-2f1f-4238-9bb0-6d35c713fe60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:24.716060 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af2b71-2f1f-4238-9bb0-6d35c713fe60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:24.716342 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af2b71-2f1f-4238-9bb0-6d35c713fe60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:24.716679 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af2b71-2f1f-4238-9bb0-6d35c713fe60 admin admin] PATH_INFO: `/v3/projects/b582fb2d2f8949c2958e1e822ef3b25c/users/f25c5042309f462daf4ee90adb4be81d/roles/028945f544094c26933c8ef60a480e9a` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:24.721321 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 761/1553] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 22 20:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:44:24.725503 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd3ce3-b630-4339-94c1-4bad3915e342 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:24.732708 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af2b71-2f1f-4238-9bb0-6d35c713fe60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b582fb2d2f8949c2958e1e822ef3b25c, user_id=f25c5042309f462daf4ee90adb4be81d, role_id=028945f544094c26933c8ef60a480e9a)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:24.733798 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: WARNING py.warnings [None req-d3af2b71-2f1f-4238-9bb0-6d35c713fe60 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:44:24.733798 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: warnings.warn(msg) Aug 22 20:44:24.733798 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: Aug 22 20:44:24.735730 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3af2b71-2f1f-4238-9bb0-6d35c713fe60 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:24.735893 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd3ce3-b630-4339-94c1-4bad3915e342 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:24.740531 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5fc4d-322f-4619-8681-c581618c91f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:24.741206 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5fc4d-322f-4619-8681-c581618c91f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:24.741480 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5fc4d-322f-4619-8681-c581618c91f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:24.741749 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5fc4d-322f-4619-8681-c581618c91f7 admin admin] PATH_INFO: `/v3/projects/e8db37443fb545aa9f8cc4c73eed2ab6/users/081684e1cd1244259c78f89a9eb6759b/roles/028945f544094c26933c8ef60a480e9a` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:24.757191 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5fc4d-322f-4619-8681-c581618c91f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8db37443fb545aa9f8cc4c73eed2ab6, user_id=081684e1cd1244259c78f89a9eb6759b, role_id=028945f544094c26933c8ef60a480e9a)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:24.760894 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5fc4d-322f-4619-8681-c581618c91f7 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:24.763097 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:44:24.792987 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 793/1554] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 22 20:44:24 2022] PUT /identity/v3/projects/b582fb2d2f8949c2958e1e822ef3b25c/users/f25c5042309f462daf4ee90adb4be81d/roles/028945f544094c26933c8ef60a480e9a => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:44:24.798627 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db74f0b-774c-41e2-a4d8-2791c5fa0984 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:24.798915 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db74f0b-774c-41e2-a4d8-2791c5fa0984 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:24.799193 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db74f0b-774c-41e2-a4d8-2791c5fa0984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:24.819013 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-2db74f0b-774c-41e2-a4d8-2791c5fa0984 None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:24.820259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-2db74f0b-774c-41e2-a4d8-2791c5fa0984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:24.827346 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 762/1555] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 22 20:44:24 2022] PUT /identity/v3/projects/e8db37443fb545aa9f8cc4c73eed2ab6/users/081684e1cd1244259c78f89a9eb6759b/roles/028945f544094c26933c8ef60a480e9a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:44:24.832594 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bc2ed-d468-4ad6-9f3e-d6c2d765bbbc None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:24.833344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bc2ed-d468-4ad6-9f3e-d6c2d765bbbc None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:24.833847 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bc2ed-d468-4ad6-9f3e-d6c2d765bbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:24.855733 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-8a3bc2ed-d468-4ad6-9f3e-d6c2d765bbbc None None] MFA Rules not processed for user `1d89af55e2b04afa9fa5ae15b3027c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:24.857010 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8a3bc2ed-d468-4ad6-9f3e-d6c2d765bbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:24.873698 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:44:24.885514 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 794/1556] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 22 20:44:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:24.895821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db74f0b-774c-41e2-a4d8-2791c5fa0984 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:24.897698 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-2db74f0b-774c-41e2-a4d8-2791c5fa0984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:24.922599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 763/1557] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 22 20:44:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:44:24.932999 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3bc2ed-d468-4ad6-9f3e-d6c2d765bbbc None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:24.934335 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8a3bc2ed-d468-4ad6-9f3e-d6c2d765bbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:24.957563 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db74f0b-774c-41e2-a4d8-2791c5fa0984 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:24.961666 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f89454-5c68-4685-b62a-141ebb0bdfeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:24.962262 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f89454-5c68-4685-b62a-141ebb0bdfeb service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:24.962942 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f89454-5c68-4685-b62a-141ebb0bdfeb service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:24.963231 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f89454-5c68-4685-b62a-141ebb0bdfeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:24.972708 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f89454-5c68-4685-b62a-141ebb0bdfeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:24.974140 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f89454-5c68-4685-b62a-141ebb0bdfeb service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:24.984973 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 795/1558] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:44:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:44:24.992701 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3bc2ed-d468-4ad6-9f3e-d6c2d765bbbc None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:24.996350 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe5990-3e8a-487a-a46f-298098a9bccc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:24.996982 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe5990-3e8a-487a-a46f-298098a9bccc service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:24.997254 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe5990-3e8a-487a-a46f-298098a9bccc service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:24.997520 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe5990-3e8a-487a-a46f-298098a9bccc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:25.007634 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe5990-3e8a-487a-a46f-298098a9bccc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:25.009241 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbe5990-3e8a-487a-a46f-298098a9bccc service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:25.019052 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 764/1559] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:44:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:44:31.690533 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd5f3d-ae2e-44ae-aa39-c73d38ce53aa None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:31.691119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd5f3d-ae2e-44ae-aa39-c73d38ce53aa None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:31.696270 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd5f3d-ae2e-44ae-aa39-c73d38ce53aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:31.776220 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-8cfd5f3d-ae2e-44ae-aa39-c73d38ce53aa None None] MFA Rules not processed for user `081684e1cd1244259c78f89a9eb6759b`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:31.776220 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-8cfd5f3d-ae2e-44ae-aa39-c73d38ce53aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:31.888210 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 796/1560] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 22 20:44:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:31.888438 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe5990-3e8a-487a-a46f-298098a9bccc service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:31.904030 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe5990-3e8a-487a-a46f-298098a9bccc service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:31.912027 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fff1d5-741d-4638-8073-b5e3bd38681a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:31.913029 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fff1d5-741d-4638-8073-b5e3bd38681a admin admin] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:31.919270 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fff1d5-741d-4638-8073-b5e3bd38681a admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:31.919270 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fff1d5-741d-4638-8073-b5e3bd38681a admin admin] PATH_INFO: `/v3/projects` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:31.919270 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fff1d5-741d-4638-8073-b5e3bd38681a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:31.919270 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fff1d5-741d-4638-8073-b5e3bd38681a admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:32.095863 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 765/1561] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 22 20:44:31 2022] POST /identity/v3/projects => generated 377 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:44:32.097409 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd5f3d-ae2e-44ae-aa39-c73d38ce53aa None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:32.122286 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd5f3d-ae2e-44ae-aa39-c73d38ce53aa None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:32.218026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfe6e5-9733-4c1d-bc89-99ffa62f1222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:32.219467 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfe6e5-9733-4c1d-bc89-99ffa62f1222 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:32.220786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfe6e5-9733-4c1d-bc89-99ffa62f1222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:32.221500 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfe6e5-9733-4c1d-bc89-99ffa62f1222 admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:32.222772 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbfe6e5-9733-4c1d-bc89-99ffa62f1222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:32.225275 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbfe6e5-9733-4c1d-bc89-99ffa62f1222 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:32.320735 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 797/1562] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 22 20:44:32 2022] POST /identity/v3/users => generated 295 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 20:44:32.325092 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fff1d5-741d-4638-8073-b5e3bd38681a admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:32.354562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fff1d5-741d-4638-8073-b5e3bd38681a admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:32.356028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26d9f2-b040-496a-b71b-e47cfa9238cb None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:32.356518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26d9f2-b040-496a-b71b-e47cfa9238cb None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:32.356904 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26d9f2-b040-496a-b71b-e47cfa9238cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:32.360846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6b433-5dc9-4215-9de6-101bc419ad32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:32.361330 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6b433-5dc9-4215-9de6-101bc419ad32 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:32.361606 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6b433-5dc9-4215-9de6-101bc419ad32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:32.361873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd6b433-5dc9-4215-9de6-101bc419ad32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:32.362518 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd6b433-5dc9-4215-9de6-101bc419ad32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:32.364118 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd6b433-5dc9-4215-9de6-101bc419ad32 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:32.376168 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 766/1563] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 22 20:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:44:32.380413 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6b433-5dc9-4215-9de6-101bc419ad32 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:32.394561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd6b433-5dc9-4215-9de6-101bc419ad32 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:32.404489 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f594d39-9978-44bd-ac4b-b3a691e69fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:32.405482 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-ab26d9f2-b040-496a-b71b-e47cfa9238cb None None] MFA Rules not processed for user `f25c5042309f462daf4ee90adb4be81d`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:32.406435 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f594d39-9978-44bd-ac4b-b3a691e69fbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:32.406711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f594d39-9978-44bd-ac4b-b3a691e69fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:32.407004 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f594d39-9978-44bd-ac4b-b3a691e69fbf admin admin] PATH_INFO: `/v3/projects/3aa2429715cd4cabae0c2416494e20ed/users/2d4fa322dfd64cd69966fd8a1214b62f/roles/e3faa0474c054da6bb4d8910a4e40bff` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:32.407124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-ab26d9f2-b040-496a-b71b-e47cfa9238cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:32.413166 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:44:32.433817 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f594d39-9978-44bd-ac4b-b3a691e69fbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aa2429715cd4cabae0c2416494e20ed, user_id=2d4fa322dfd64cd69966fd8a1214b62f, role_id=e3faa0474c054da6bb4d8910a4e40bff)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:32.438005 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f594d39-9978-44bd-ac4b-b3a691e69fbf admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:32.486075 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 798/1564] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 22 20:44:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:32.490808 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26d9f2-b040-496a-b71b-e47cfa9238cb None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:32.503960 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26d9f2-b040-496a-b71b-e47cfa9238cb None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:32.510568 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2a254-4844-4b66-b93d-1e3e0f0afd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:32.511368 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2a254-4844-4b66-b93d-1e3e0f0afd51 admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:32.511642 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2a254-4844-4b66-b93d-1e3e0f0afd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:32.511935 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2a254-4844-4b66-b93d-1e3e0f0afd51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:32.512571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2a254-4844-4b66-b93d-1e3e0f0afd51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:32.514921 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2a254-4844-4b66-b93d-1e3e0f0afd51 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:32.525400 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 767/1565] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 22 20:44:32 2022] PUT /identity/v3/projects/3aa2429715cd4cabae0c2416494e20ed/users/2d4fa322dfd64cd69966fd8a1214b62f/roles/e3faa0474c054da6bb4d8910a4e40bff => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:44:32.529372 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f594d39-9978-44bd-ac4b-b3a691e69fbf admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:32.616171 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:44:32.644243 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f594d39-9978-44bd-ac4b-b3a691e69fbf admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:32.646178 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 799/1566] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Aug 22 20:44:32 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:44:32.650453 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2a254-4844-4b66-b93d-1e3e0f0afd51 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:32.715176 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74b938-8e0a-4537-aa25-c871f7a9c655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:32.715858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74b938-8e0a-4537-aa25-c871f7a9c655 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:32.716140 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74b938-8e0a-4537-aa25-c871f7a9c655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:32.716407 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74b938-8e0a-4537-aa25-c871f7a9c655 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:32.717106 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74b938-8e0a-4537-aa25-c871f7a9c655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:32.719556 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74b938-8e0a-4537-aa25-c871f7a9c655 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:32.730749 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 768/1567] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 22 20:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:44:32.734128 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2a254-4844-4b66-b93d-1e3e0f0afd51 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:32.735876 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74b938-8e0a-4537-aa25-c871f7a9c655 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:32.740592 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b75fa-5847-44af-8e74-f3f16357ce8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:32.741544 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b75fa-5847-44af-8e74-f3f16357ce8f admin admin] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:32.741849 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b75fa-5847-44af-8e74-f3f16357ce8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:32.748649 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b75fa-5847-44af-8e74-f3f16357ce8f admin admin] PATH_INFO: `/v3/users` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:32.748649 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b75fa-5847-44af-8e74-f3f16357ce8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:32.748649 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b75fa-5847-44af-8e74-f3f16357ce8f admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:32.749453 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74b938-8e0a-4537-aa25-c871f7a9c655 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:32.754851 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82ee2e-d516-4d09-853d-a1c53551be61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:32.755078 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82ee2e-d516-4d09-853d-a1c53551be61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:32.756431 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82ee2e-d516-4d09-853d-a1c53551be61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:32.756885 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82ee2e-d516-4d09-853d-a1c53551be61 admin admin] PATH_INFO: `/v3/projects/3aa2429715cd4cabae0c2416494e20ed/users/2d4fa322dfd64cd69966fd8a1214b62f/roles/e3faa0474c054da6bb4d8910a4e40bff` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:32.759472 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82ee2e-d516-4d09-853d-a1c53551be61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aa2429715cd4cabae0c2416494e20ed, user_id=2d4fa322dfd64cd69966fd8a1214b62f, role_id=e3faa0474c054da6bb4d8910a4e40bff)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:32.762731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e82ee2e-d516-4d09-853d-a1c53551be61 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:32.775474 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 769/1568] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 22 20:44:32 2022] PUT /identity/v3/projects/3aa2429715cd4cabae0c2416494e20ed/users/2d4fa322dfd64cd69966fd8a1214b62f/roles/e3faa0474c054da6bb4d8910a4e40bff => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:44:32.878758 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 800/1569] 10.222.0.62 () {60 vars in 1144 bytes} [Mon Aug 22 20:44:32 2022] POST /identity/v3/users => generated 298 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 20:44:32.882675 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82ee2e-d516-4d09-853d-a1c53551be61 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:32.961954 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e82ee2e-d516-4d09-853d-a1c53551be61 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:32.968800 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7634098-7635-4999-b726-c9f9f70bd926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:32.969414 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7634098-7635-4999-b726-c9f9f70bd926 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:32.969865 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7634098-7635-4999-b726-c9f9f70bd926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:32.970138 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7634098-7635-4999-b726-c9f9f70bd926 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:32.970785 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7634098-7635-4999-b726-c9f9f70bd926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:32.972798 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7634098-7635-4999-b726-c9f9f70bd926 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:32.989632 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 770/1570] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 22 20:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:44:32.989964 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b75fa-5847-44af-8e74-f3f16357ce8f admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:33.003253 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b75fa-5847-44af-8e74-f3f16357ce8f admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:33.009680 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d57934-5a13-4b77-bde9-a8cd00fd7f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:33.016044 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d57934-5a13-4b77-bde9-a8cd00fd7f4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:33.016044 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d57934-5a13-4b77-bde9-a8cd00fd7f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:33.016044 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d57934-5a13-4b77-bde9-a8cd00fd7f4a admin admin] PATH_INFO: `/v3/projects/b4e5c265730b4447be158048c0c47dd0/users/88c5b269012c48949ea84e196f5397db/roles/e3faa0474c054da6bb4d8910a4e40bff` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:33.042806 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d57934-5a13-4b77-bde9-a8cd00fd7f4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4e5c265730b4447be158048c0c47dd0, user_id=88c5b269012c48949ea84e196f5397db, role_id=e3faa0474c054da6bb4d8910a4e40bff)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:33.046256 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d57934-5a13-4b77-bde9-a8cd00fd7f4a admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:33.129581 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 801/1571] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 22 20:44:32 2022] PUT /identity/v3/projects/b4e5c265730b4447be158048c0c47dd0/users/88c5b269012c48949ea84e196f5397db/roles/e3faa0474c054da6bb4d8910a4e40bff => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 20:44:33.131373 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7634098-7635-4999-b726-c9f9f70bd926 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:33.147025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7634098-7635-4999-b726-c9f9f70bd926 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:33.220336 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f6c9a-2640-49f7-b9ea-293331a526c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:33.221224 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f6c9a-2640-49f7-b9ea-293331a526c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:33.224175 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f6c9a-2640-49f7-b9ea-293331a526c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:33.224175 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f6c9a-2640-49f7-b9ea-293331a526c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:33.224175 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f6c9a-2640-49f7-b9ea-293331a526c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:33.224433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f6c9a-2640-49f7-b9ea-293331a526c0 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:33.236762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 771/1572] 10.222.0.62 () {58 vars in 1122 bytes} [Mon Aug 22 20:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 20:44:33.240475 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d57934-5a13-4b77-bde9-a8cd00fd7f4a admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:33.256700 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d57934-5a13-4b77-bde9-a8cd00fd7f4a admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:33.262347 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b48ee-53ad-4cba-8551-b904f8312344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:33.263204 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b48ee-53ad-4cba-8551-b904f8312344 admin admin] REQUEST_METHOD: `PUT` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:33.267138 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b48ee-53ad-4cba-8551-b904f8312344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:33.267521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b48ee-53ad-4cba-8551-b904f8312344 admin admin] PATH_INFO: `/v3/projects/b4e5c265730b4447be158048c0c47dd0/users/88c5b269012c48949ea84e196f5397db/roles/e3faa0474c054da6bb4d8910a4e40bff` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:33.270066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b48ee-53ad-4cba-8551-b904f8312344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4e5c265730b4447be158048c0c47dd0, user_id=88c5b269012c48949ea84e196f5397db, role_id=e3faa0474c054da6bb4d8910a4e40bff)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:33.273215 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b48ee-53ad-4cba-8551-b904f8312344 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:33.301880 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 802/1573] 10.222.0.62 () {60 vars in 1483 bytes} [Mon Aug 22 20:44:33 2022] PUT /identity/v3/projects/b4e5c265730b4447be158048c0c47dd0/users/88c5b269012c48949ea84e196f5397db/roles/e3faa0474c054da6bb4d8910a4e40bff => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:44:40.066000 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b21cb2-68cc-416c-8705-93e54b839242 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:40.066530 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b21cb2-68cc-416c-8705-93e54b839242 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:40.066697 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b21cb2-68cc-416c-8705-93e54b839242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:40.084766 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:44:40.122119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-e9b21cb2-68cc-416c-8705-93e54b839242 None None] MFA Rules not processed for user `2d4fa322dfd64cd69966fd8a1214b62f`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:40.124526 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-e9b21cb2-68cc-416c-8705-93e54b839242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:40.228041 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 772/1574] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 22 20:44:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:40.243500 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b48ee-53ad-4cba-8551-b904f8312344 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:40.246755 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-5b9b48ee-53ad-4cba-8551-b904f8312344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:40.338425 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:44:40.428527 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b48ee-53ad-4cba-8551-b904f8312344 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:40.434787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e4553-6c14-441d-9720-4972a4db07bf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e298bcbaf84866b4fc6c6f65216fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:40.435482 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e4553-6c14-441d-9720-4972a4db07bf service glance] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:40.436355 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e4553-6c14-441d-9720-4972a4db07bf service glance] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:40.443624 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e4553-6c14-441d-9720-4972a4db07bf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:40.551216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e4553-6c14-441d-9720-4972a4db07bf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:40.553483 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e4553-6c14-441d-9720-4972a4db07bf service glance] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:40.568767 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 803/1575] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:44:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:44:40.667680 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531b8df-cfd8-493b-9b1d-2394f5004b27 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:40.667970 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531b8df-cfd8-493b-9b1d-2394f5004b27 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:40.668246 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531b8df-cfd8-493b-9b1d-2394f5004b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:40.703727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-8531b8df-cfd8-493b-9b1d-2394f5004b27 None None] MFA Rules not processed for user `88c5b269012c48949ea84e196f5397db`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:40.705033 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8531b8df-cfd8-493b-9b1d-2394f5004b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:40.804994 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 773/1576] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 22 20:44:40 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:40.819049 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e4553-6c14-441d-9720-4972a4db07bf service glance] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:40.820262 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-8a7e4553-6c14-441d-9720-4972a4db07bf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:40.832203 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e4553-6c14-441d-9720-4972a4db07bf service glance] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:40.836527 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e92722-1fc6-4f3b-986c-439b38637037 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e298bcbaf84866b4fc6c6f65216fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:40.837180 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e92722-1fc6-4f3b-986c-439b38637037 service glance] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:40.837595 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e92722-1fc6-4f3b-986c-439b38637037 service glance] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:40.837880 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e92722-1fc6-4f3b-986c-439b38637037 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:40.910105 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e92722-1fc6-4f3b-986c-439b38637037 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:40.911567 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e92722-1fc6-4f3b-986c-439b38637037 service glance] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:40.923657 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 804/1577] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:44:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:44:41.220710 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab44c7b-457a-40c1-8b40-89e89de8110f None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:41.221544 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab44c7b-457a-40c1-8b40-89e89de8110f None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:41.221829 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab44c7b-457a-40c1-8b40-89e89de8110f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:41.276696 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-5ab44c7b-457a-40c1-8b40-89e89de8110f None None] MFA Rules not processed for user `51ed4c996cde4e88be26544c48200695`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:41.278095 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-5ab44c7b-457a-40c1-8b40-89e89de8110f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:41.325954 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:44:41.348048 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 774/1578] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Aug 22 20:44:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:41.727575 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e92722-1fc6-4f3b-986c-439b38637037 service glance] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:41.729064 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-19e92722-1fc6-4f3b-986c-439b38637037 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:41.819565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=100 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:44:41.837571 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e92722-1fc6-4f3b-986c-439b38637037 service glance] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:41.843472 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2f8c4-97d9-48a5-b701-9c4416ad23c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '907607fd209b416ba9b68512772c1d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:41.844081 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2f8c4-97d9-48a5-b701-9c4416ad23c2 service swift] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:41.844357 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2f8c4-97d9-48a5-b701-9c4416ad23c2 service swift] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:41.844645 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2f8c4-97d9-48a5-b701-9c4416ad23c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:41.853025 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e2f8c4-97d9-48a5-b701-9c4416ad23c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:41.854593 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e2f8c4-97d9-48a5-b701-9c4416ad23c2 service swift] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:41.863861 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 805/1579] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Aug 22 20:44:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 20:44:42.852977 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009a8e5-bc75-4d0f-94c5-44ed4e7b9604 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:42.853485 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009a8e5-bc75-4d0f-94c5-44ed4e7b9604 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:42.853554 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009a8e5-bc75-4d0f-94c5-44ed4e7b9604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:42.887762 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-8009a8e5-bc75-4d0f-94c5-44ed4e7b9604 None None] MFA Rules not processed for user `51ed4c996cde4e88be26544c48200695`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:42.894028 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8009a8e5-bc75-4d0f-94c5-44ed4e7b9604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:42.906594 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 775/1580] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Aug 22 20:44:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:42.915340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2f8c4-97d9-48a5-b701-9c4416ad23c2 service swift] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:42.926658 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2f8c4-97d9-48a5-b701-9c4416ad23c2 service swift] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:42.933822 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb372d65-f858-40e9-8e3e-9fd49aa9cae4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '907607fd209b416ba9b68512772c1d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:42.934465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb372d65-f858-40e9-8e3e-9fd49aa9cae4 service swift] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:42.934723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb372d65-f858-40e9-8e3e-9fd49aa9cae4 service swift] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:42.935009 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb372d65-f858-40e9-8e3e-9fd49aa9cae4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:42.944928 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb372d65-f858-40e9-8e3e-9fd49aa9cae4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:42.955810 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb372d65-f858-40e9-8e3e-9fd49aa9cae4 service swift] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:42.962841 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 806/1581] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Aug 22 20:44:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 20:44:52.880333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=10 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:44:52.953047 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=15 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:44:53.814246 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a54df-d1a2-46a7-b313-0b6c45707c01 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:53.815429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a54df-d1a2-46a7-b313-0b6c45707c01 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:53.815429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a54df-d1a2-46a7-b313-0b6c45707c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:53.834324 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-f77a54df-d1a2-46a7-b313-0b6c45707c01 None None] MFA Rules not processed for user `f25c5042309f462daf4ee90adb4be81d`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:53.835562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f77a54df-d1a2-46a7-b313-0b6c45707c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:53.843277 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 776/1582] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 22 20:44:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:54.143592 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e49072-d5d5-467c-904d-be8c1b08f103 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:54.145770 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e49072-d5d5-467c-904d-be8c1b08f103 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:54.145770 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e49072-d5d5-467c-904d-be8c1b08f103 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:54.145770 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 807/1583] 10.222.0.62 () {54 vars in 962 bytes} [Mon Aug 22 20:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:44:54.150781 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a599f-12b2-4119-be2d-b03cd6cc7c54 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:54.151269 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a599f-12b2-4119-be2d-b03cd6cc7c54 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:54.151365 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a599f-12b2-4119-be2d-b03cd6cc7c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:54.194784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-809a599f-12b2-4119-be2d-b03cd6cc7c54 None None] MFA Rules not processed for user `9f1738f72b4848499cdf0ec6866c3c8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:54.197460 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-809a599f-12b2-4119-be2d-b03cd6cc7c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:54.265126 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 777/1584] 10.222.0.62 () {58 vars in 1059 bytes} [Mon Aug 22 20:44:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:54.270598 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b7920-e4cc-4450-ad84-db813ec182fa None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:54.270949 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b7920-e4cc-4450-ad84-db813ec182fa None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:54.271287 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b7920-e4cc-4450-ad84-db813ec182fa None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:54.272722 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 808/1585] 10.222.0.62 () {54 vars in 912 bytes} [Mon Aug 22 20:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:44:54.278935 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787e137-55ca-4e22-a9aa-510f9741bb5e None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:54.279290 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787e137-55ca-4e22-a9aa-510f9741bb5e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:54.279828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787e137-55ca-4e22-a9aa-510f9741bb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:54.299476 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-1787e137-55ca-4e22-a9aa-510f9741bb5e None None] MFA Rules not processed for user `9f1738f72b4848499cdf0ec6866c3c8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:54.300728 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-1787e137-55ca-4e22-a9aa-510f9741bb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:54.312600 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 778/1586] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Aug 22 20:44:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:44:54.324856 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b7920-e4cc-4450-ad84-db813ec182fa None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:54.336189 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b7920-e4cc-4450-ad84-db813ec182fa None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:54.339711 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6040791-9acb-4096-8a7a-445a1d2ce364 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4e298bcbaf84866b4fc6c6f65216fc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:54.340303 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6040791-9acb-4096-8a7a-445a1d2ce364 service glance] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:54.340583 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6040791-9acb-4096-8a7a-445a1d2ce364 service glance] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:54.341462 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6040791-9acb-4096-8a7a-445a1d2ce364 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:54.351975 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6040791-9acb-4096-8a7a-445a1d2ce364 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:54.353439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6040791-9acb-4096-8a7a-445a1d2ce364 service glance] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:54.364260 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 809/1587] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:44:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:44:54.720178 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea57622-b370-4130-b84d-60d797c89463 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:54.720544 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea57622-b370-4130-b84d-60d797c89463 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:54.720781 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea57622-b370-4130-b84d-60d797c89463 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:54.722530 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 779/1588] 10.222.0.62 () {54 vars in 912 bytes} [Mon Aug 22 20:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:44:54.729120 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc77f05-2430-460f-af0f-08856f8971ef None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:54.729682 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc77f05-2430-460f-af0f-08856f8971ef None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:54.730132 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc77f05-2430-460f-af0f-08856f8971ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:54.772085 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-ddc77f05-2430-460f-af0f-08856f8971ef None None] MFA Rules not processed for user `538ba8188ed540628242c983ebd6dd1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:54.773328 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-ddc77f05-2430-460f-af0f-08856f8971ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:54.826784 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 810/1589] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Aug 22 20:44:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:54.838050 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea57622-b370-4130-b84d-60d797c89463 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:54.848939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea57622-b370-4130-b84d-60d797c89463 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:54.852351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395e82c-2495-4da8-94ef-fb56c916c6f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:54.852976 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395e82c-2495-4da8-94ef-fb56c916c6f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:54.853249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395e82c-2495-4da8-94ef-fb56c916c6f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:54.853513 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395e82c-2495-4da8-94ef-fb56c916c6f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:54.861243 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395e82c-2495-4da8-94ef-fb56c916c6f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:54.862708 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395e82c-2495-4da8-94ef-fb56c916c6f5 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:54.870509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 780/1590] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:44:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:44:55.355830 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b003fc2-7a51-4927-8763-46064ac0c29f None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:55.355830 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b003fc2-7a51-4927-8763-46064ac0c29f None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:55.355830 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b003fc2-7a51-4927-8763-46064ac0c29f None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:55.355830 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 811/1591] 10.222.0.62 () {54 vars in 962 bytes} [Mon Aug 22 20:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:44:55.361493 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a2289-47d9-472d-bbb3-e94d8c2a7307 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:55.362420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a2289-47d9-472d-bbb3-e94d8c2a7307 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:55.363023 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a2289-47d9-472d-bbb3-e94d8c2a7307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:55.375696 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3264e-6b3f-4549-a2bd-0ed661afb5a3 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:55.375696 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3264e-6b3f-4549-a2bd-0ed661afb5a3 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:55.375696 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3264e-6b3f-4549-a2bd-0ed661afb5a3 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:55.376343 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 812/1592] 10.222.0.62 () {54 vars in 961 bytes} [Mon Aug 22 20:44:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:44:55.383141 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ac693-86c3-4b29-9d09-41471487cbc9 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:55.383551 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ac693-86c3-4b29-9d09-41471487cbc9 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:55.383843 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ac693-86c3-4b29-9d09-41471487cbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:55.384300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-3d3a2289-47d9-472d-bbb3-e94d8c2a7307 None None] MFA Rules not processed for user `9f1738f72b4848499cdf0ec6866c3c8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:55.385548 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-3d3a2289-47d9-472d-bbb3-e94d8c2a7307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:55.396232 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 781/1593] 10.222.0.62 () {58 vars in 1059 bytes} [Mon Aug 22 20:44:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:55.401921 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ace941-9cf6-42a9-98f3-74a14b2b5e65 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:55.402241 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ace941-9cf6-42a9-98f3-74a14b2b5e65 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:55.402517 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ace941-9cf6-42a9-98f3-74a14b2b5e65 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:55.405171 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 782/1594] 10.222.0.62 () {54 vars in 912 bytes} [Mon Aug 22 20:44:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:44:55.410020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-e15ac693-86c3-4b29-9d09-41471487cbc9 None None] MFA Rules not processed for user `d3fdb2336b8b4f7c9b710b224a8594a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:55.410351 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e87da-b636-45bb-8411-00eb81f001a8 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:55.410638 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e87da-b636-45bb-8411-00eb81f001a8 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:55.410915 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e87da-b636-45bb-8411-00eb81f001a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:55.411540 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-e15ac693-86c3-4b29-9d09-41471487cbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:55.432406 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-090e87da-b636-45bb-8411-00eb81f001a8 None None] MFA Rules not processed for user `9f1738f72b4848499cdf0ec6866c3c8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:55.433667 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-090e87da-b636-45bb-8411-00eb81f001a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:55.444067 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 783/1595] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Aug 22 20:44:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:55.458548 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e87da-b636-45bb-8411-00eb81f001a8 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:55.469878 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e87da-b636-45bb-8411-00eb81f001a8 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:55.475700 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd4018-2b40-4fb7-9d6a-e9b720182a50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:55.476411 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd4018-2b40-4fb7-9d6a-e9b720182a50 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:55.476925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd4018-2b40-4fb7-9d6a-e9b720182a50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:55.477290 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd4018-2b40-4fb7-9d6a-e9b720182a50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:55.490786 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd4018-2b40-4fb7-9d6a-e9b720182a50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:55.492344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd4018-2b40-4fb7-9d6a-e9b720182a50 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:55.507713 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 784/1596] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:44:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:44:55.508138 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 813/1597] 10.222.0.62 () {58 vars in 1058 bytes} [Mon Aug 22 20:44:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:44:55.516871 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd4018-2b40-4fb7-9d6a-e9b720182a50 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:55.527875 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd4018-2b40-4fb7-9d6a-e9b720182a50 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:55.535622 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a88d16-5cbc-4773-bc8d-2c986d7d79ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3fdb2336b8b4f7c9b710b224a8594a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:55.536144 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a88d16-5cbc-4773-bc8d-2c986d7d79ad service placement] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:55.536424 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a88d16-5cbc-4773-bc8d-2c986d7d79ad service placement] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:55.536724 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a88d16-5cbc-4773-bc8d-2c986d7d79ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:55.538492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-62a88d16-5cbc-4773-bc8d-2c986d7d79ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:55.550828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a88d16-5cbc-4773-bc8d-2c986d7d79ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:55.552431 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a88d16-5cbc-4773-bc8d-2c986d7d79ad service placement] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:55.562565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 785/1598] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:44:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:44:59.252677 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55fe94-98d4-414a-9cb1-66baed2d9392 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:59.253145 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55fe94-98d4-414a-9cb1-66baed2d9392 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:59.253224 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55fe94-98d4-414a-9cb1-66baed2d9392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:59.273597 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-bb55fe94-98d4-414a-9cb1-66baed2d9392 None None] MFA Rules not processed for user `51ed4c996cde4e88be26544c48200695`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:44:59.275032 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-bb55fe94-98d4-414a-9cb1-66baed2d9392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:44:59.289042 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 814/1599] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Aug 22 20:44:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:44:59.298927 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a88d16-5cbc-4773-bc8d-2c986d7d79ad service placement] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:44:59.313018 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a88d16-5cbc-4773-bc8d-2c986d7d79ad service placement] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:44:59.318906 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae8781-94ee-43f9-b928-d3873f3d6b9c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '907607fd209b416ba9b68512772c1d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:44:59.319728 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae8781-94ee-43f9-b928-d3873f3d6b9c service swift] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:44:59.320416 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae8781-94ee-43f9-b928-d3873f3d6b9c service swift] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:44:59.320794 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae8781-94ee-43f9-b928-d3873f3d6b9c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:44:59.331599 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae8781-94ee-43f9-b928-d3873f3d6b9c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:44:59.333395 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae8781-94ee-43f9-b928-d3873f3d6b9c service swift] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:44:59.345714 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 786/1600] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Aug 22 20:44:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 20:45:09.268522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=67 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:45:09.340574 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=73 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:45:16.989335 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40c91a-b850-49bd-9be4-28f07a5703a6 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:16.993488 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40c91a-b850-49bd-9be4-28f07a5703a6 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:16.993488 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40c91a-b850-49bd-9be4-28f07a5703a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:17.009733 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-dd40c91a-b850-49bd-9be4-28f07a5703a6 None None] MFA Rules not processed for user `538ba8188ed540628242c983ebd6dd1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:45:17.011229 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-dd40c91a-b850-49bd-9be4-28f07a5703a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:45:17.018709 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 815/1601] 10.222.0.75 () {58 vars in 1015 bytes} [Mon Aug 22 20:45:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:45:17.032423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae8781-94ee-43f9-b928-d3873f3d6b9c service swift] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:45:17.043123 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae8781-94ee-43f9-b928-d3873f3d6b9c service swift] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:45:17.047337 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57370e-6efc-49a3-aa39-d8eed8daaa88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:45:17.047923 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57370e-6efc-49a3-aa39-d8eed8daaa88 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:17.048200 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57370e-6efc-49a3-aa39-d8eed8daaa88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:17.048477 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57370e-6efc-49a3-aa39-d8eed8daaa88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:17.056562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57370e-6efc-49a3-aa39-d8eed8daaa88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:45:17.058094 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57370e-6efc-49a3-aa39-d8eed8daaa88 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:45:17.066250 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 787/1602] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:45:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:45:18.073951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23f6b5-a5d6-4b30-b732-ac8470cda1fd None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:18.074895 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23f6b5-a5d6-4b30-b732-ac8470cda1fd None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:18.075053 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23f6b5-a5d6-4b30-b732-ac8470cda1fd None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:18.076538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 816/1603] 10.222.0.62 () {54 vars in 921 bytes} [Mon Aug 22 20:45:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:45:18.099921 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de199c-c6be-40c1-8963-a8381efc3a57 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:18.100831 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de199c-c6be-40c1-8963-a8381efc3a57 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:18.101990 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de199c-c6be-40c1-8963-a8381efc3a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:18.128166 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-56de199c-c6be-40c1-8963-a8381efc3a57 None None] MFA Rules not processed for user `9f1738f72b4848499cdf0ec6866c3c8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:45:18.128166 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-56de199c-c6be-40c1-8963-a8381efc3a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:45:18.137107 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 788/1604] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Aug 22 20:45:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:45:18.150789 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23f6b5-a5d6-4b30-b732-ac8470cda1fd None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:45:18.167911 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23f6b5-a5d6-4b30-b732-ac8470cda1fd None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:45:18.175360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a36b9-0feb-4305-9d40-55fc1a017aad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1738f72b4848499cdf0ec6866c3c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:45:18.176373 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a36b9-0feb-4305-9d40-55fc1a017aad service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:18.176732 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a36b9-0feb-4305-9d40-55fc1a017aad service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:18.177015 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a36b9-0feb-4305-9d40-55fc1a017aad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:18.190468 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a36b9-0feb-4305-9d40-55fc1a017aad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:45:18.192092 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a36b9-0feb-4305-9d40-55fc1a017aad service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:45:18.204059 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 817/1605] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:45:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:45:25.903338 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522768ad-8ea4-4e44-854e-42ed7c866421 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:25.904008 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522768ad-8ea4-4e44-854e-42ed7c866421 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:25.904287 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522768ad-8ea4-4e44-854e-42ed7c866421 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:25.906201 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 789/1606] 10.222.0.62 () {54 vars in 921 bytes} [Mon Aug 22 20:45:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 20:45:25.915828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ded88-ee06-4649-a7df-903ca108b8bf None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:25.917020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ded88-ee06-4649-a7df-903ca108b8bf None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:25.917020 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ded88-ee06-4649-a7df-903ca108b8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:25.941205 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-484ded88-ee06-4649-a7df-903ca108b8bf None None] MFA Rules not processed for user `9f1738f72b4848499cdf0ec6866c3c8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:45:25.942423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-484ded88-ee06-4649-a7df-903ca108b8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:45:25.951693 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 818/1607] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Aug 22 20:45:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:45:25.967537 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522768ad-8ea4-4e44-854e-42ed7c866421 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:45:25.982765 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522768ad-8ea4-4e44-854e-42ed7c866421 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:45:25.989745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fff053-7307-4b12-9347-9c680e5a2bdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1738f72b4848499cdf0ec6866c3c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:45:25.989745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fff053-7307-4b12-9347-9c680e5a2bdd service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:25.989745 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fff053-7307-4b12-9347-9c680e5a2bdd service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:25.990171 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fff053-7307-4b12-9347-9c680e5a2bdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:26.002661 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fff053-7307-4b12-9347-9c680e5a2bdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:45:26.004309 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fff053-7307-4b12-9347-9c680e5a2bdd service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:45:26.016080 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 790/1608] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:45:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:45:35.936326 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=12 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:45:36.011051 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=15 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:45:48.750220 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6262a-144c-4d47-a418-10682119fa44 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:48.750744 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6262a-144c-4d47-a418-10682119fa44 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:48.750828 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6262a-144c-4d47-a418-10682119fa44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:48.777305 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-98f6262a-144c-4d47-a418-10682119fa44 None None] MFA Rules not processed for user `081684e1cd1244259c78f89a9eb6759b`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:45:48.778532 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-98f6262a-144c-4d47-a418-10682119fa44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:45:48.786134 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 819/1609] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 22 20:45:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 20:45:58.771877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:45:59.301352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fff053-7307-4b12-9347-9c680e5a2bdd service nova] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:45:59.312609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fff053-7307-4b12-9347-9c680e5a2bdd service nova] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:45:59.318404 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef7c70-09d1-4b40-a841-97fafaa25515 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:45:59.319559 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef7c70-09d1-4b40-a841-97fafaa25515 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:45:59.319894 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef7c70-09d1-4b40-a841-97fafaa25515 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:45:59.321224 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef7c70-09d1-4b40-a841-97fafaa25515 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:45:59.338763 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef7c70-09d1-4b40-a841-97fafaa25515 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:45:59.340974 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef7c70-09d1-4b40-a841-97fafaa25515 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:45:59.353458 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 791/1610] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:45:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:46:02.044287 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa024c7-a748-4ad8-803d-39f3389aa7c2 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:02.056176 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa024c7-a748-4ad8-803d-39f3389aa7c2 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:02.056176 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa024c7-a748-4ad8-803d-39f3389aa7c2 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:02.056176 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 820/1611] 10.222.0.62 () {54 vars in 921 bytes} [Mon Aug 22 20:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:46:02.056496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e0566-7245-45f9-94a6-ae028a899069 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:02.056496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e0566-7245-45f9-94a6-ae028a899069 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:02.056496 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e0566-7245-45f9-94a6-ae028a899069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:02.074018 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-0e5e0566-7245-45f9-94a6-ae028a899069 None None] MFA Rules not processed for user `9f1738f72b4848499cdf0ec6866c3c8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:46:02.075274 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-0e5e0566-7245-45f9-94a6-ae028a899069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:46:02.084977 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 792/1612] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Aug 22 20:46:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:46:02.106686 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa024c7-a748-4ad8-803d-39f3389aa7c2 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:46:02.121735 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa024c7-a748-4ad8-803d-39f3389aa7c2 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:46:02.127568 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeeb8b4-54b4-47ee-a8a1-39194643e69b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1738f72b4848499cdf0ec6866c3c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:46:02.128182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeeb8b4-54b4-47ee-a8a1-39194643e69b service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:02.128455 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeeb8b4-54b4-47ee-a8a1-39194643e69b service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:02.128751 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeeb8b4-54b4-47ee-a8a1-39194643e69b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:02.138448 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeeb8b4-54b4-47ee-a8a1-39194643e69b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:46:02.140064 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeeb8b4-54b4-47ee-a8a1-39194643e69b service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:46:02.152930 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 821/1613] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:46:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:46:12.068333 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=9 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:46:12.146868 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=6 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:46:55.966873 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3de8e6-7c91-4b56-8b7f-d77d13fea6eb None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:46:55.967413 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3de8e6-7c91-4b56-8b7f-d77d13fea6eb None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:46:55.967413 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3de8e6-7c91-4b56-8b7f-d77d13fea6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:46:55.986185 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-fb3de8e6-7c91-4b56-8b7f-d77d13fea6eb None None] MFA Rules not processed for user `081684e1cd1244259c78f89a9eb6759b`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:46:55.987402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-fb3de8e6-7c91-4b56-8b7f-d77d13fea6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:46:55.994429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 793/1614] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 22 20:46:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:47:05.981086 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:47:18.826644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c78b9-0a01-47e0-a46d-75e03819c6b2 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:18.827252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c78b9-0a01-47e0-a46d-75e03819c6b2 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:18.827252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c78b9-0a01-47e0-a46d-75e03819c6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:18.848257 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-ac1c78b9-0a01-47e0-a46d-75e03819c6b2 None None] MFA Rules not processed for user `51ed4c996cde4e88be26544c48200695`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:47:18.849512 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-ac1c78b9-0a01-47e0-a46d-75e03819c6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:47:18.856950 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 822/1615] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Aug 22 20:47:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:47:18.900374 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3de8e6-7c91-4b56-8b7f-d77d13fea6eb None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:47:18.913089 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3de8e6-7c91-4b56-8b7f-d77d13fea6eb None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:47:18.918057 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd97e6-efed-4379-84c9-04ba4aa1966e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '907607fd209b416ba9b68512772c1d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:47:18.918663 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd97e6-efed-4379-84c9-04ba4aa1966e service swift] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:18.918944 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd97e6-efed-4379-84c9-04ba4aa1966e service swift] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:18.919216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd97e6-efed-4379-84c9-04ba4aa1966e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:18.928963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd97e6-efed-4379-84c9-04ba4aa1966e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:47:18.930543 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd97e6-efed-4379-84c9-04ba4aa1966e service swift] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:47:18.939736 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 794/1616] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Aug 22 20:47:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 20:47:24.481224 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc78a71-b1da-4ac9-8c2a-9aeb8be563a8 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:24.481727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc78a71-b1da-4ac9-8c2a-9aeb8be563a8 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:24.481727 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc78a71-b1da-4ac9-8c2a-9aeb8be563a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:24.501067 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-fdc78a71-b1da-4ac9-8c2a-9aeb8be563a8 None None] MFA Rules not processed for user `081684e1cd1244259c78f89a9eb6759b`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:47:24.502645 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-fdc78a71-b1da-4ac9-8c2a-9aeb8be563a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:47:24.509239 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 823/1617] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 22 20:47:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:47:24.789035 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502ce34-6cbd-49dc-842d-e5bfaf1f008d None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:24.789565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502ce34-6cbd-49dc-842d-e5bfaf1f008d None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:24.789565 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502ce34-6cbd-49dc-842d-e5bfaf1f008d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:24.809490 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-8502ce34-6cbd-49dc-842d-e5bfaf1f008d None None] MFA Rules not processed for user `538ba8188ed540628242c983ebd6dd1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:47:24.810692 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-8502ce34-6cbd-49dc-842d-e5bfaf1f008d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:47:24.817982 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 795/1618] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Aug 22 20:47:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:47:24.830513 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc78a71-b1da-4ac9-8c2a-9aeb8be563a8 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:47:24.840002 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc78a71-b1da-4ac9-8c2a-9aeb8be563a8 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:47:24.843771 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100db96c-d1d5-4c7a-80aa-2e6790ff2cf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:47:24.844451 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100db96c-d1d5-4c7a-80aa-2e6790ff2cf5 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:24.844751 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100db96c-d1d5-4c7a-80aa-2e6790ff2cf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:24.845214 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100db96c-d1d5-4c7a-80aa-2e6790ff2cf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:24.852731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100db96c-d1d5-4c7a-80aa-2e6790ff2cf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:47:24.854145 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100db96c-d1d5-4c7a-80aa-2e6790ff2cf5 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:47:24.862853 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 824/1619] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:47:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:47:34.804759 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=9 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:47:34.858815 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=12 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:47:56.184021 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502ce34-6cbd-49dc-842d-e5bfaf1f008d None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:47:56.196690 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502ce34-6cbd-49dc-842d-e5bfaf1f008d None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:47:56.201808 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac44509-71da-4d7c-a649-030fb4a7781b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3fdb2336b8b4f7c9b710b224a8594a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:47:56.202402 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac44509-71da-4d7c-a649-030fb4a7781b service placement] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:47:56.202680 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac44509-71da-4d7c-a649-030fb4a7781b service placement] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:47:56.202949 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac44509-71da-4d7c-a649-030fb4a7781b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:47:56.212335 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac44509-71da-4d7c-a649-030fb4a7781b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:47:56.214044 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac44509-71da-4d7c-a649-030fb4a7781b service placement] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:47:56.224149 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 796/1620] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:47:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:48:04.733871 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d21ed-6add-4546-816f-5c157227ecdc None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:48:04.734714 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d21ed-6add-4546-816f-5c157227ecdc None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:48:04.735153 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d21ed-6add-4546-816f-5c157227ecdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:48:04.754239 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-bc5d21ed-6add-4546-816f-5c157227ecdc None None] MFA Rules not processed for user `51ed4c996cde4e88be26544c48200695`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:48:04.755439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-bc5d21ed-6add-4546-816f-5c157227ecdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:48:04.763293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 825/1621] 10.222.0.62 () {58 vars in 967 bytes} [Mon Aug 22 20:48:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:48:04.775797 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac44509-71da-4d7c-a649-030fb4a7781b service placement] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:48:04.787902 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac44509-71da-4d7c-a649-030fb4a7781b service placement] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:48:04.793647 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055af40-5975-4e7c-9b24-11135a60b07a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '907607fd209b416ba9b68512772c1d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:48:04.794362 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055af40-5975-4e7c-9b24-11135a60b07a service swift] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:48:04.794811 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055af40-5975-4e7c-9b24-11135a60b07a service swift] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:48:04.795091 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055af40-5975-4e7c-9b24-11135a60b07a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:48:04.803738 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9055af40-5975-4e7c-9b24-11135a60b07a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:48:04.805372 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9055af40-5975-4e7c-9b24-11135a60b07a service swift] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:48:04.814292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 797/1622] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Aug 22 20:48:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 20:48:14.750103 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:48:14.810963 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=12 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:48:35.427070 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdaa2cc-8b5f-46b8-87da-28113e376ee9 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:48:35.427555 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdaa2cc-8b5f-46b8-87da-28113e376ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:48:35.427664 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdaa2cc-8b5f-46b8-87da-28113e376ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:48:35.447228 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-6fdaa2cc-8b5f-46b8-87da-28113e376ee9 None None] MFA Rules not processed for user `081684e1cd1244259c78f89a9eb6759b`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:48:35.448420 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-6fdaa2cc-8b5f-46b8-87da-28113e376ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:48:35.455371 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 826/1623] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 22 20:48:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:48:45.442661 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=3 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:49:01.770439 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055af40-5975-4e7c-9b24-11135a60b07a service swift] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:49:01.780263 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055af40-5975-4e7c-9b24-11135a60b07a service swift] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:49:01.783925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05aeb49-e374-426e-9854-7313b08a94cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:49:01.784799 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05aeb49-e374-426e-9854-7313b08a94cc service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:49:01.785080 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05aeb49-e374-426e-9854-7313b08a94cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:49:01.785357 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05aeb49-e374-426e-9854-7313b08a94cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:49:01.795162 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05aeb49-e374-426e-9854-7313b08a94cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:49:01.797144 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05aeb49-e374-426e-9854-7313b08a94cc service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:49:01.806413 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 798/1624] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:49:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:49:11.802006 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=6 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:50:22.835811 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdaa2cc-8b5f-46b8-87da-28113e376ee9 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:50:22.848961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdaa2cc-8b5f-46b8-87da-28113e376ee9 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:50:22.854470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f7873-33f5-454c-9804-7d33636c0f45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1738f72b4848499cdf0ec6866c3c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:50:22.855072 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f7873-33f5-454c-9804-7d33636c0f45 service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:50:22.855350 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f7873-33f5-454c-9804-7d33636c0f45 service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:50:22.855820 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f7873-33f5-454c-9804-7d33636c0f45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:50:22.864297 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f7873-33f5-454c-9804-7d33636c0f45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:50:22.868548 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f7873-33f5-454c-9804-7d33636c0f45 service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:50:22.874845 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 827/1625] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:50:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:50:22.924182 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05aeb49-e374-426e-9854-7313b08a94cc service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:50:22.932855 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05aeb49-e374-426e-9854-7313b08a94cc service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:50:22.936603 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10344f82-f024-400f-8dbe-891e73dc76f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:50:22.937249 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10344f82-f024-400f-8dbe-891e73dc76f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:50:22.937521 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10344f82-f024-400f-8dbe-891e73dc76f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:50:22.937787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10344f82-f024-400f-8dbe-891e73dc76f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:50:22.948021 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10344f82-f024-400f-8dbe-891e73dc76f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:50:22.949485 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10344f82-f024-400f-8dbe-891e73dc76f2 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:50:22.960819 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 799/1626] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:50:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:50:23.436344 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f7873-33f5-454c-9804-7d33636c0f45 service nova] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:50:23.458924 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f7873-33f5-454c-9804-7d33636c0f45 service nova] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:50:23.467530 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d47e0-88a4-41df-ad7d-b34be36fb1f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1738f72b4848499cdf0ec6866c3c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:50:23.468730 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d47e0-88a4-41df-ad7d-b34be36fb1f1 service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:50:23.473292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d47e0-88a4-41df-ad7d-b34be36fb1f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:50:23.473292 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d47e0-88a4-41df-ad7d-b34be36fb1f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:50:23.483555 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d47e0-88a4-41df-ad7d-b34be36fb1f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:50:23.486640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d47e0-88a4-41df-ad7d-b34be36fb1f1 service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:50:23.533254 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 828/1627] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:50:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 20:50:23.616296 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10344f82-f024-400f-8dbe-891e73dc76f2 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:50:23.625821 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10344f82-f024-400f-8dbe-891e73dc76f2 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:50:23.629796 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14447794-e8d9-42ee-898e-9f682f5df138 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:50:23.630469 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14447794-e8d9-42ee-898e-9f682f5df138 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:50:23.630749 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14447794-e8d9-42ee-898e-9f682f5df138 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:50:23.631024 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14447794-e8d9-42ee-898e-9f682f5df138 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:50:23.639780 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14447794-e8d9-42ee-898e-9f682f5df138 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:50:23.642349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14447794-e8d9-42ee-898e-9f682f5df138 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:50:23.651139 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 800/1628] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:50:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:50:25.156899 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d47e0-88a4-41df-ad7d-b34be36fb1f1 service nova] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:50:25.215878 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d47e0-88a4-41df-ad7d-b34be36fb1f1 service nova] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:50:25.219846 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551f03c-6442-44fc-a284-b9b4201a1a98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '893e204cfff74570b3226b2e8c47df57', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:50:25.220618 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551f03c-6442-44fc-a284-b9b4201a1a98 service cinder] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:50:25.220909 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551f03c-6442-44fc-a284-b9b4201a1a98 service cinder] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:50:25.221447 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551f03c-6442-44fc-a284-b9b4201a1a98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:50:25.232265 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551f03c-6442-44fc-a284-b9b4201a1a98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:50:25.234338 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551f03c-6442-44fc-a284-b9b4201a1a98 service cinder] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:50:25.246171 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 829/1629] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:50:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:50:33.051164 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02902790-3713-4504-bd26-e4ccf06c246e None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:50:33.051612 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02902790-3713-4504-bd26-e4ccf06c246e None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:50:33.051751 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02902790-3713-4504-bd26-e4ccf06c246e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:50:33.071382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-02902790-3713-4504-bd26-e4ccf06c246e None None] MFA Rules not processed for user `51ed4c996cde4e88be26544c48200695`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:50:33.072601 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-02902790-3713-4504-bd26-e4ccf06c246e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:50:33.080960 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 801/1630] 10.222.0.62 () {58 vars in 967 bytes} [Mon Aug 22 20:50:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:50:33.226410 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551f03c-6442-44fc-a284-b9b4201a1a98 service cinder] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:50:33.238486 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551f03c-6442-44fc-a284-b9b4201a1a98 service cinder] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:50:33.243522 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6e0e9-f0ae-48ce-ab92-7d6222b444e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '907607fd209b416ba9b68512772c1d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:50:33.244128 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6e0e9-f0ae-48ce-ab92-7d6222b444e1 service swift] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:50:33.244407 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6e0e9-f0ae-48ce-ab92-7d6222b444e1 service swift] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:50:33.244707 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6e0e9-f0ae-48ce-ab92-7d6222b444e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:50:33.254409 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a6e0e9-f0ae-48ce-ab92-7d6222b444e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:50:33.255997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a6e0e9-f0ae-48ce-ab92-7d6222b444e1 service swift] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:50:33.264624 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 830/1631] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Aug 22 20:50:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 20:50:34.469411 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd6453-80d3-4105-b296-973644f2340b None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:50:34.469877 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd6453-80d3-4105-b296-973644f2340b None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:50:34.469961 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd6453-80d3-4105-b296-973644f2340b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:50:34.491431 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-32dd6453-80d3-4105-b296-973644f2340b None None] MFA Rules not processed for user `51ed4c996cde4e88be26544c48200695`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:50:34.492631 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-32dd6453-80d3-4105-b296-973644f2340b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:50:34.499708 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 802/1632] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Aug 22 20:50:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:50:34.511590 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6e0e9-f0ae-48ce-ab92-7d6222b444e1 service swift] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:50:34.522530 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6e0e9-f0ae-48ce-ab92-7d6222b444e1 service swift] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:50:34.527416 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b00da6-bdb7-46f9-bd70-2435dbb1c2fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '907607fd209b416ba9b68512772c1d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:50:34.528008 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b00da6-bdb7-46f9-bd70-2435dbb1c2fd service swift] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:50:34.528284 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b00da6-bdb7-46f9-bd70-2435dbb1c2fd service swift] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:50:34.528552 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b00da6-bdb7-46f9-bd70-2435dbb1c2fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:50:34.537230 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b00da6-bdb7-46f9-bd70-2435dbb1c2fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:50:34.538797 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b00da6-bdb7-46f9-bd70-2435dbb1c2fd service swift] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:50:34.546854 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 831/1633] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Aug 22 20:50:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 20:50:44.484709 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=18 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:50:44.543704 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=50 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:50:44.857854 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a378e-be02-42eb-bc21-e4c9df40ce90 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:50:44.858067 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a378e-be02-42eb-bc21-e4c9df40ce90 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:50:44.858334 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a378e-be02-42eb-bc21-e4c9df40ce90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:50:44.879151 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-2a9a378e-be02-42eb-bc21-e4c9df40ce90 None None] MFA Rules not processed for user `f25c5042309f462daf4ee90adb4be81d`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:50:44.880360 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-2a9a378e-be02-42eb-bc21-e4c9df40ce90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:50:44.887086 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 803/1634] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 22 20:50:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:50:45.814848 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b00da6-bdb7-46f9-bd70-2435dbb1c2fd service swift] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:50:45.828291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b00da6-bdb7-46f9-bd70-2435dbb1c2fd service swift] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:50:45.835758 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebcf6c-a4a0-40f9-b1c6-85d3432c298d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3fdb2336b8b4f7c9b710b224a8594a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:50:45.836644 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebcf6c-a4a0-40f9-b1c6-85d3432c298d service placement] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:50:45.837136 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebcf6c-a4a0-40f9-b1c6-85d3432c298d service placement] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:50:45.837401 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebcf6c-a4a0-40f9-b1c6-85d3432c298d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:50:45.847715 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cebcf6c-a4a0-40f9-b1c6-85d3432c298d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:50:45.849372 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cebcf6c-a4a0-40f9-b1c6-85d3432c298d service placement] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:50:45.860507 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 832/1635] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:50:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:50:48.551014 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5895f2e-a2da-49b4-b694-f66fd545d41a None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:50:48.551519 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5895f2e-a2da-49b4-b694-f66fd545d41a None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:50:48.551614 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5895f2e-a2da-49b4-b694-f66fd545d41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:50:48.571620 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-f5895f2e-a2da-49b4-b694-f66fd545d41a None None] MFA Rules not processed for user `51ed4c996cde4e88be26544c48200695`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:50:48.572939 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-f5895f2e-a2da-49b4-b694-f66fd545d41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:50:48.581173 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 804/1636] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Aug 22 20:50:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:50:48.593798 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebcf6c-a4a0-40f9-b1c6-85d3432c298d service placement] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:50:48.605895 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebcf6c-a4a0-40f9-b1c6-85d3432c298d service placement] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:50:48.611415 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84205a-07ff-4026-bf2e-8312836bdeda service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '907607fd209b416ba9b68512772c1d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:50:48.612799 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84205a-07ff-4026-bf2e-8312836bdeda service swift] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:50:48.612799 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84205a-07ff-4026-bf2e-8312836bdeda service swift] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:50:48.612799 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84205a-07ff-4026-bf2e-8312836bdeda service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:50:48.621713 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d84205a-07ff-4026-bf2e-8312836bdeda service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:50:48.623298 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d84205a-07ff-4026-bf2e-8312836bdeda service swift] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:50:48.631862 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 833/1637] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Aug 22 20:50:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 20:50:58.565525 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=6 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:50:58.628361 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=12 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:51:05.671835 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5895f2e-a2da-49b4-b694-f66fd545d41a None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:05.687626 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5895f2e-a2da-49b4-b694-f66fd545d41a None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:05.690109 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a199c-9258-4feb-8210-437af4def1e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1738f72b4848499cdf0ec6866c3c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:05.690706 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a199c-9258-4feb-8210-437af4def1e1 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:05.690976 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a199c-9258-4feb-8210-437af4def1e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:05.691240 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a199c-9258-4feb-8210-437af4def1e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:05.700423 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a199c-9258-4feb-8210-437af4def1e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:05.702081 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a199c-9258-4feb-8210-437af4def1e1 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:05.712411 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 805/1638] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:51:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:51:15.708179 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=6 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:51:20.555300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84205a-07ff-4026-bf2e-8312836bdeda service swift] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:20.566645 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84205a-07ff-4026-bf2e-8312836bdeda service swift] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:20.570242 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa12b7-608c-46d2-b804-34bf8394b0b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:20.570829 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa12b7-608c-46d2-b804-34bf8394b0b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:20.571106 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa12b7-608c-46d2-b804-34bf8394b0b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:20.571372 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa12b7-608c-46d2-b804-34bf8394b0b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:20.580582 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fa12b7-608c-46d2-b804-34bf8394b0b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:20.582026 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fa12b7-608c-46d2-b804-34bf8394b0b8 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:20.592252 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 834/1639] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:51:20 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:51:22.644119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a199c-9258-4feb-8210-437af4def1e1 service nova] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:22.656858 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a199c-9258-4feb-8210-437af4def1e1 service nova] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:22.662894 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db29f8-1979-4da2-8838-f50349760522 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1738f72b4848499cdf0ec6866c3c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:22.663780 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db29f8-1979-4da2-8838-f50349760522 service nova] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:22.664270 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db29f8-1979-4da2-8838-f50349760522 service nova] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:22.664768 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db29f8-1979-4da2-8838-f50349760522 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:22.675641 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db29f8-1979-4da2-8838-f50349760522 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:22.677373 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db29f8-1979-4da2-8838-f50349760522 service nova] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:22.689752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 806/1640] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:51:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:51:30.587851 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=6 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:51:30.896854 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa12b7-608c-46d2-b804-34bf8394b0b8 service neutron] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:51:30.910414 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa12b7-608c-46d2-b804-34bf8394b0b8 service neutron] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:51:30.916156 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0329f-ab3a-4860-aa67-b9fcbe01c173 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1738f72b4848499cdf0ec6866c3c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:51:30.916778 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0329f-ab3a-4860-aa67-b9fcbe01c173 service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:30.917054 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0329f-ab3a-4860-aa67-b9fcbe01c173 service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:30.917324 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0329f-ab3a-4860-aa67-b9fcbe01c173 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:30.927054 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0329f-ab3a-4860-aa67-b9fcbe01c173 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:51:30.928775 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0329f-ab3a-4860-aa67-b9fcbe01c173 service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:51:30.938590 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 835/1641] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:51:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:51:32.683580 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=6 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:51:36.481433 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162acd27-73c8-470e-bb04-4dcf5ece9737 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:51:36.482067 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162acd27-73c8-470e-bb04-4dcf5ece9737 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:51:36.482067 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162acd27-73c8-470e-bb04-4dcf5ece9737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:51:36.500436 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-162acd27-73c8-470e-bb04-4dcf5ece9737 None None] MFA Rules not processed for user `081684e1cd1244259c78f89a9eb6759b`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:51:36.501676 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-162acd27-73c8-470e-bb04-4dcf5ece9737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:51:36.508677 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 807/1642] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 22 20:51:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:51:40.934270 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=6 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:51:46.495682 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=3 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:53:53.904808 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0329f-ab3a-4860-aa67-b9fcbe01c173 service nova] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:53:53.906509 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-dae0329f-ab3a-4860-aa67-b9fcbe01c173 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:53:54.002098 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0329f-ab3a-4860-aa67-b9fcbe01c173 service nova] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:53:54.007841 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3368e2-746a-46e4-80b0-38902e061bc5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3fdb2336b8b4f7c9b710b224a8594a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:53:54.008498 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3368e2-746a-46e4-80b0-38902e061bc5 service placement] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:53:54.008813 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3368e2-746a-46e4-80b0-38902e061bc5 service placement] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:53:54.009083 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3368e2-746a-46e4-80b0-38902e061bc5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:53:54.011595 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-8a3368e2-746a-46e4-80b0-38902e061bc5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:53:54.023306 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3368e2-746a-46e4-80b0-38902e061bc5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:53:54.025062 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3368e2-746a-46e4-80b0-38902e061bc5 service placement] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:53:54.036397 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 836/1643] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:53:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:53:57.173469 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e83529-7b81-49b9-a7ef-c97382829eae None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:53:57.174019 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e83529-7b81-49b9-a7ef-c97382829eae None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:53:57.174019 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e83529-7b81-49b9-a7ef-c97382829eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:53:57.210152 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-17e83529-7b81-49b9-a7ef-c97382829eae None None] MFA Rules not processed for user `51ed4c996cde4e88be26544c48200695`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:53:57.211382 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-17e83529-7b81-49b9-a7ef-c97382829eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:53:57.226776 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 808/1644] 10.222.0.62 () {58 vars in 967 bytes} [Mon Aug 22 20:53:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:53:57.268704 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3368e2-746a-46e4-80b0-38902e061bc5 service placement] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:53:57.281149 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3368e2-746a-46e4-80b0-38902e061bc5 service placement] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:53:57.286123 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0742b7-157b-4b14-bdd2-8dd46d7dee4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '907607fd209b416ba9b68512772c1d17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:53:57.286730 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0742b7-157b-4b14-bdd2-8dd46d7dee4f service swift] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:53:57.287011 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0742b7-157b-4b14-bdd2-8dd46d7dee4f service swift] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:53:57.287283 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0742b7-157b-4b14-bdd2-8dd46d7dee4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:53:57.296924 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0742b7-157b-4b14-bdd2-8dd46d7dee4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:53:57.298605 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0742b7-157b-4b14-bdd2-8dd46d7dee4f service swift] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:53:57.308811 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 837/1645] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Aug 22 20:53:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 20:53:58.948287 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e83529-7b81-49b9-a7ef-c97382829eae None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:53:58.968338 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e83529-7b81-49b9-a7ef-c97382829eae None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:53:58.972094 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1e278-08b1-4e12-b62c-41310aa800dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:53:58.972802 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1e278-08b1-4e12-b62c-41310aa800dd service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:53:58.973082 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1e278-08b1-4e12-b62c-41310aa800dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:53:58.973352 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1e278-08b1-4e12-b62c-41310aa800dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:53:59.050396 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1e278-08b1-4e12-b62c-41310aa800dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:53:59.051789 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1e278-08b1-4e12-b62c-41310aa800dd service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:53:59.070725 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 809/1646] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:53:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:53:59.528130 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148fec0-3453-4526-b7cc-38aff9c44c78 None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:53:59.528744 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148fec0-3453-4526-b7cc-38aff9c44c78 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:53:59.528744 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148fec0-3453-4526-b7cc-38aff9c44c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:53:59.547773 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-4148fec0-3453-4526-b7cc-38aff9c44c78 None None] MFA Rules not processed for user `081684e1cd1244259c78f89a9eb6759b`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:53:59.549066 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-4148fec0-3453-4526-b7cc-38aff9c44c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:53:59.556038 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 838/1647] 10.222.0.62 () {58 vars in 958 bytes} [Mon Aug 22 20:53:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:53:59.880278 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1e278-08b1-4e12-b62c-41310aa800dd service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:53:59.881927 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-62c1e278-08b1-4e12-b62c-41310aa800dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:53:59.905807 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1e278-08b1-4e12-b62c-41310aa800dd service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:53:59.909403 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b480f8-723d-4ceb-b972-293ae30fc9db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:53:59.910016 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b480f8-723d-4ceb-b972-293ae30fc9db service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:53:59.910318 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b480f8-723d-4ceb-b972-293ae30fc9db service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:53:59.910585 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b480f8-723d-4ceb-b972-293ae30fc9db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:53:59.918412 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b480f8-723d-4ceb-b972-293ae30fc9db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:53:59.919876 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b480f8-723d-4ceb-b972-293ae30fc9db service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:53:59.928102 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 810/1648] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:53:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:54:02.956295 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdd3de-d09c-4c77-8081-34b5bfd0a2d9 None None] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:54:02.959492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdd3de-d09c-4c77-8081-34b5bfd0a2d9 None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:54:02.959492 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdd3de-d09c-4c77-8081-34b5bfd0a2d9 None None] PATH_INFO: `/` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:54:02.960287 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 839/1649] 10.222.0.62 () {54 vars in 921 bytes} [Mon Aug 22 20:54:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:54:03.002324 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af705e-1666-47ed-9d4b-1fdcc9c3f590 None None] REQUEST_METHOD: `POST` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:54:03.002812 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af705e-1666-47ed-9d4b-1fdcc9c3f590 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:54:03.002905 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af705e-1666-47ed-9d4b-1fdcc9c3f590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:54:03.068914 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.auth.core [None req-b7af705e-1666-47ed-9d4b-1fdcc9c3f590 None None] MFA Rules not processed for user `d3fdb2336b8b4f7c9b710b224a8594a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81638) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:54:03.072369 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-b7af705e-1666-47ed-9d4b-1fdcc9c3f590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:54:03.079810 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 811/1650] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Aug 22 20:54:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:54:03.095621 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdd3de-d09c-4c77-8081-34b5bfd0a2d9 None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:54:03.111384 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdd3de-d09c-4c77-8081-34b5bfd0a2d9 None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:54:03.118117 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d67d50-7255-4123-b0be-47566e278832 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3fdb2336b8b4f7c9b710b224a8594a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:54:03.120891 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d67d50-7255-4123-b0be-47566e278832 service placement] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:54:03.120891 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d67d50-7255-4123-b0be-47566e278832 service placement] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:54:03.120891 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d67d50-7255-4123-b0be-47566e278832 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:54:03.131542 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d67d50-7255-4123-b0be-47566e278832 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:54:03.133546 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d67d50-7255-4123-b0be-47566e278832 service placement] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:54:03.145205 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 840/1651] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:54:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:54:08.504713 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699c7f8-cc07-4b00-be7c-43d1fa2eb7f0 None None] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:54:08.505235 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699c7f8-cc07-4b00-be7c-43d1fa2eb7f0 None None] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:54:08.505345 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699c7f8-cc07-4b00-be7c-43d1fa2eb7f0 None None] PATH_INFO: `/` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:54:08.507222 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 812/1652] 10.222.0.62 () {54 vars in 921 bytes} [Mon Aug 22 20:54:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 20:54:08.518810 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f431e-1901-4be7-8d5c-0b7767818cbc None None] REQUEST_METHOD: `POST` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:54:08.523300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f431e-1901-4be7-8d5c-0b7767818cbc None None] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:54:08.523300 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f431e-1901-4be7-8d5c-0b7767818cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:54:08.545031 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.auth.core [None req-f70f431e-1901-4be7-8d5c-0b7767818cbc None None] MFA Rules not processed for user `d3fdb2336b8b4f7c9b710b224a8594a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81637) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 20:54:08.546722 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-f70f431e-1901-4be7-8d5c-0b7767818cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:54:08.557180 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 841/1653] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Aug 22 20:54:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 20:54:08.574380 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699c7f8-cc07-4b00-be7c-43d1fa2eb7f0 None None] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:54:08.588434 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699c7f8-cc07-4b00-be7c-43d1fa2eb7f0 None None] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:54:08.594160 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f6d97-2bea-43c3-9374-6be2bf8b054d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3fdb2336b8b4f7c9b710b224a8594a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:54:08.594749 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f6d97-2bea-43c3-9374-6be2bf8b054d service placement] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:54:08.595022 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f6d97-2bea-43c3-9374-6be2bf8b054d service placement] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:54:08.595291 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f6d97-2bea-43c3-9374-6be2bf8b054d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:54:08.603759 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f6d97-2bea-43c3-9374-6be2bf8b054d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:54:08.606124 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f6d97-2bea-43c3-9374-6be2bf8b054d service placement] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:54:08.615987 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 813/1654] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:54:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:54:08.660805 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f431e-1901-4be7-8d5c-0b7767818cbc None None] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:54:08.675090 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f431e-1901-4be7-8d5c-0b7767818cbc None None] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:54:08.681623 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a718c-10ae-482a-becb-878ddc0ef645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:54:08.682255 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a718c-10ae-482a-becb-878ddc0ef645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:54:08.682561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a718c-10ae-482a-becb-878ddc0ef645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:54:08.683033 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a718c-10ae-482a-becb-878ddc0ef645 admin admin] PATH_INFO: `/v3/users/f25c5042309f462daf4ee90adb4be81d` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:54:08.684323 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a718c-10ae-482a-becb-878ddc0ef645 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f25c5042309f462daf4ee90adb4be81d)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:54:08.685419 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: WARNING py.warnings [None req-e18a718c-10ae-482a-becb-878ddc0ef645 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:54:08.685419 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: warnings.warn(msg) Aug 22 20:54:08.685419 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: Aug 22 20:54:08.686625 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a718c-10ae-482a-becb-878ddc0ef645 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:54:08.876562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e18a718c-10ae-482a-becb-878ddc0ef645 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f25c5042309f462daf4ee90adb4be81d'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:54:08.894840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e18a718c-10ae-482a-becb-878ddc0ef645 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f25c5042309f462daf4ee90adb4be81d'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:54:08.895535 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e18a718c-10ae-482a-becb-878ddc0ef645 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f25c5042309f462daf4ee90adb4be81d'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:54:08.906678 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e18a718c-10ae-482a-becb-878ddc0ef645 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f25c5042309f462daf4ee90adb4be81d'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:54:08.990969 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-e18a718c-10ae-482a-becb-878ddc0ef645 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f25c5042309f462daf4ee90adb4be81d'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:54:08.997870 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 842/1655] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 22 20:54:08 2022] DELETE /identity/v3/users/f25c5042309f462daf4ee90adb4be81d => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:54:09.289662 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f6d97-2bea-43c3-9374-6be2bf8b054d service placement] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:54:09.303050 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f6d97-2bea-43c3-9374-6be2bf8b054d service placement] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:54:09.347555 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=100 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:54:09.365562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d83e84-c489-41a7-9771-ad4325373fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:54:09.366195 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d83e84-c489-41a7-9771-ad4325373fc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:54:09.366478 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d83e84-c489-41a7-9771-ad4325373fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:54:09.366752 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d83e84-c489-41a7-9771-ad4325373fc4 admin admin] PATH_INFO: `/v3/projects/b582fb2d2f8949c2958e1e822ef3b25c` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:54:09.367930 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d83e84-c489-41a7-9771-ad4325373fc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b582fb2d2f8949c2958e1e822ef3b25c)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:54:09.368985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: WARNING py.warnings [None req-56d83e84-c489-41a7-9771-ad4325373fc4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 20:54:09.368985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: warnings.warn(msg) Aug 22 20:54:09.368985 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: Aug 22 20:54:09.372926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d83e84-c489-41a7-9771-ad4325373fc4 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:54:09.502486 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-56d83e84-c489-41a7-9771-ad4325373fc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b582fb2d2f8949c2958e1e822ef3b25c', 'request_id': 'req-56d83e84-c489-41a7-9771-ad4325373fc4'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:54:09.508971 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-56d83e84-c489-41a7-9771-ad4325373fc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b582fb2d2f8949c2958e1e822ef3b25c', 'request_id': 'req-56d83e84-c489-41a7-9771-ad4325373fc4'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:54:09.580216 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-56d83e84-c489-41a7-9771-ad4325373fc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b582fb2d2f8949c2958e1e822ef3b25c', 'request_id': 'req-56d83e84-c489-41a7-9771-ad4325373fc4'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:54:09.615243 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-56d83e84-c489-41a7-9771-ad4325373fc4 admin admin] The token cache is being invalidate because project b582fb2d2f8949c2958e1e822ef3b25c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:54:09.615537 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-56d83e84-c489-41a7-9771-ad4325373fc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:54:09.616186 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-56d83e84-c489-41a7-9771-ad4325373fc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:54:09.617721 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 814/1656] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 22 20:54:09 2022] DELETE /identity/v3/projects/b582fb2d2f8949c2958e1e822ef3b25c => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:54:09.622689 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a718c-10ae-482a-becb-878ddc0ef645 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:54:09.624210 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-e18a718c-10ae-482a-becb-878ddc0ef645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:54:09.638178 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a718c-10ae-482a-becb-878ddc0ef645 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:54:09.646064 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:54:09.697024 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9268aa-aab1-4f93-bb01-21c08236fb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:54:09.697669 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9268aa-aab1-4f93-bb01-21c08236fb42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:54:09.697976 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9268aa-aab1-4f93-bb01-21c08236fb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:54:09.698406 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9268aa-aab1-4f93-bb01-21c08236fb42 admin admin] PATH_INFO: `/v3/users/88c5b269012c48949ea84e196f5397db` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:54:09.699552 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9268aa-aab1-4f93-bb01-21c08236fb42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88c5b269012c48949ea84e196f5397db)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:54:09.701554 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9268aa-aab1-4f93-bb01-21c08236fb42 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:54:09.886055 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-bf9268aa-aab1-4f93-bb01-21c08236fb42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88c5b269012c48949ea84e196f5397db'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:54:09.898003 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-bf9268aa-aab1-4f93-bb01-21c08236fb42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88c5b269012c48949ea84e196f5397db'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:54:09.898701 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-bf9268aa-aab1-4f93-bb01-21c08236fb42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88c5b269012c48949ea84e196f5397db'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:54:09.905479 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-bf9268aa-aab1-4f93-bb01-21c08236fb42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88c5b269012c48949ea84e196f5397db'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:54:09.962465 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-bf9268aa-aab1-4f93-bb01-21c08236fb42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88c5b269012c48949ea84e196f5397db'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:54:09.968714 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 843/1657] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 22 20:54:09 2022] DELETE /identity/v3/users/88c5b269012c48949ea84e196f5397db => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:54:10.198444 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d83e84-c489-41a7-9771-ad4325373fc4 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:54:10.202283 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-56d83e84-c489-41a7-9771-ad4325373fc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:54:10.214583 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d83e84-c489-41a7-9771-ad4325373fc4 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:54:10.272940 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db898f32-9b59-4eac-9a65-cfc2403ec4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:54:10.273572 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db898f32-9b59-4eac-9a65-cfc2403ec4b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:54:10.273849 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db898f32-9b59-4eac-9a65-cfc2403ec4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:54:10.274118 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db898f32-9b59-4eac-9a65-cfc2403ec4b3 admin admin] PATH_INFO: `/v3/projects/b4e5c265730b4447be158048c0c47dd0` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:54:10.275227 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db898f32-9b59-4eac-9a65-cfc2403ec4b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4e5c265730b4447be158048c0c47dd0)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:54:10.278007 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db898f32-9b59-4eac-9a65-cfc2403ec4b3 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:54:10.369962 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-db898f32-9b59-4eac-9a65-cfc2403ec4b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4e5c265730b4447be158048c0c47dd0', 'request_id': 'req-db898f32-9b59-4eac-9a65-cfc2403ec4b3'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:54:10.375578 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-db898f32-9b59-4eac-9a65-cfc2403ec4b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4e5c265730b4447be158048c0c47dd0', 'request_id': 'req-db898f32-9b59-4eac-9a65-cfc2403ec4b3'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:54:10.378106 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:54:10.442948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-db898f32-9b59-4eac-9a65-cfc2403ec4b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4e5c265730b4447be158048c0c47dd0', 'request_id': 'req-db898f32-9b59-4eac-9a65-cfc2403ec4b3'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:54:10.454997 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-db898f32-9b59-4eac-9a65-cfc2403ec4b3 admin admin] The token cache is being invalidate because project b4e5c265730b4447be158048c0c47dd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:54:10.455286 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-db898f32-9b59-4eac-9a65-cfc2403ec4b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:54:10.455951 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-db898f32-9b59-4eac-9a65-cfc2403ec4b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:54:10.457462 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 815/1658] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 22 20:54:10 2022] DELETE /identity/v3/projects/b4e5c265730b4447be158048c0c47dd0 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:54:19.246163 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9268aa-aab1-4f93-bb01-21c08236fb42 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:54:19.247606 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-bf9268aa-aab1-4f93-bb01-21c08236fb42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:54:19.306484 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9268aa-aab1-4f93-bb01-21c08236fb42 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:54:19.352827 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:54:19.359286 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc78fa1-17e0-4fe5-b552-3f0668613b2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:54:19.360569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc78fa1-17e0-4fe5-b552-3f0668613b2d service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:54:19.360569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc78fa1-17e0-4fe5-b552-3f0668613b2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:54:19.360569 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc78fa1-17e0-4fe5-b552-3f0668613b2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:54:19.362331 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-8cc78fa1-17e0-4fe5-b552-3f0668613b2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:54:19.425948 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc78fa1-17e0-4fe5-b552-3f0668613b2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:54:19.427425 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc78fa1-17e0-4fe5-b552-3f0668613b2d service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:54:19.438391 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 844/1659] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:54:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:54:20.522596 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:DELETE=1,keystone:SELECT=4 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:54:29.465359 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=29 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:55:50.057444 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db898f32-9b59-4eac-9a65-cfc2403ec4b3 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:55:50.058946 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-db898f32-9b59-4eac-9a65-cfc2403ec4b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:55:50.071056 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db898f32-9b59-4eac-9a65-cfc2403ec4b3 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:55:50.074561 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfacffe-4324-4568-96ba-247e3b266604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:55:50.075185 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfacffe-4324-4568-96ba-247e3b266604 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:55:50.075449 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfacffe-4324-4568-96ba-247e3b266604 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:55:50.075723 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfacffe-4324-4568-96ba-247e3b266604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:55:50.077429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-6dfacffe-4324-4568-96ba-247e3b266604 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:55:50.086605 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfacffe-4324-4568-96ba-247e3b266604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:55:50.088037 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfacffe-4324-4568-96ba-247e3b266604 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:55:50.095854 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 816/1660] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:55:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:56:00.092562 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=6 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:56:12.017157 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc78fa1-17e0-4fe5-b552-3f0668613b2d service neutron] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:56:12.026538 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc78fa1-17e0-4fe5-b552-3f0668613b2d service neutron] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:56:12.030315 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870bad2-2a87-473a-810e-ea9d461c8f29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:56:12.030928 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870bad2-2a87-473a-810e-ea9d461c8f29 service neutron] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:56:12.031207 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870bad2-2a87-473a-810e-ea9d461c8f29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:56:12.031480 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870bad2-2a87-473a-810e-ea9d461c8f29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:56:12.033265 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-f870bad2-2a87-473a-810e-ea9d461c8f29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:56:12.138460 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f870bad2-2a87-473a-810e-ea9d461c8f29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:56:12.139986 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f870bad2-2a87-473a-810e-ea9d461c8f29 service neutron] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:56:12.163585 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 845/1661] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:56:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:56:13.511938 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfacffe-4324-4568-96ba-247e3b266604 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:56:13.522603 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfacffe-4324-4568-96ba-247e3b266604 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:56:13.526609 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7736ec-565e-403e-88df-d083a538f2fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:56:13.527219 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7736ec-565e-403e-88df-d083a538f2fe service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:56:13.527494 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7736ec-565e-403e-88df-d083a538f2fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:56:13.527759 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7736ec-565e-403e-88df-d083a538f2fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:56:13.529585 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-bd7736ec-565e-403e-88df-d083a538f2fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:56:13.546941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7736ec-565e-403e-88df-d083a538f2fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:56:13.546941 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7736ec-565e-403e-88df-d083a538f2fe service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:56:13.557547 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 817/1662] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:56:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:56:14.623235 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870bad2-2a87-473a-810e-ea9d461c8f29 service neutron] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:56:14.624862 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-f870bad2-2a87-473a-810e-ea9d461c8f29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:56:14.638572 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870bad2-2a87-473a-810e-ea9d461c8f29 service neutron] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:56:14.648078 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d39d9e-bb2f-47d3-903b-369de6640348 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f1738f72b4848499cdf0ec6866c3c8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:56:14.648078 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d39d9e-bb2f-47d3-903b-369de6640348 service nova] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:56:14.648078 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d39d9e-bb2f-47d3-903b-369de6640348 service nova] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:56:14.648078 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d39d9e-bb2f-47d3-903b-369de6640348 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:56:14.648470 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-64d39d9e-bb2f-47d3-903b-369de6640348 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:56:14.659340 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d39d9e-bb2f-47d3-903b-369de6640348 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:56:14.662049 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d39d9e-bb2f-47d3-903b-369de6640348 service nova] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:56:14.672346 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 846/1663] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:56:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:56:23.552375 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=6 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:56:24.667774 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=49 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:56:28.893722 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7736ec-565e-403e-88df-d083a538f2fe service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:56:28.903005 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7736ec-565e-403e-88df-d083a538f2fe service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:56:28.910007 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bcb7d3-3d99-4571-a22b-312a9f42b2a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '538ba8188ed540628242c983ebd6dd1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:56:28.910007 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcb7d3-3d99-4571-a22b-312a9f42b2a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:56:28.910007 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcb7d3-3d99-4571-a22b-312a9f42b2a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:56:28.910007 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcb7d3-3d99-4571-a22b-312a9f42b2a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:56:28.911094 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-13bcb7d3-3d99-4571-a22b-312a9f42b2a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:56:28.973110 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bcb7d3-3d99-4571-a22b-312a9f42b2a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:56:28.974550 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bcb7d3-3d99-4571-a22b-312a9f42b2a1 service neutron] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:56:28.984223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 818/1664] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:56:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:56:36.210429 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d39d9e-bb2f-47d3-903b-369de6640348 service nova] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:56:36.212588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-64d39d9e-bb2f-47d3-903b-369de6640348 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:56:36.226524 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d39d9e-bb2f-47d3-903b-369de6640348 service nova] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:56:36.231185 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756bf11-c77b-4e7b-b811-f338d12b84f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:56:36.232156 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756bf11-c77b-4e7b-b811-f338d12b84f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:56:36.232460 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756bf11-c77b-4e7b-b811-f338d12b84f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:56:36.232766 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756bf11-c77b-4e7b-b811-f338d12b84f4 admin admin] PATH_INFO: `/v3/users/081684e1cd1244259c78f89a9eb6759b` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:56:36.248032 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a756bf11-c77b-4e7b-b811-f338d12b84f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=081684e1cd1244259c78f89a9eb6759b)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:56:36.250033 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a756bf11-c77b-4e7b-b811-f338d12b84f4 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:56:36.407447 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-a756bf11-c77b-4e7b-b811-f338d12b84f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '081684e1cd1244259c78f89a9eb6759b'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:36.420140 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-a756bf11-c77b-4e7b-b811-f338d12b84f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '081684e1cd1244259c78f89a9eb6759b'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:36.420826 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-a756bf11-c77b-4e7b-b811-f338d12b84f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '081684e1cd1244259c78f89a9eb6759b'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:36.427536 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-a756bf11-c77b-4e7b-b811-f338d12b84f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '081684e1cd1244259c78f89a9eb6759b'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:36.499259 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-a756bf11-c77b-4e7b-b811-f338d12b84f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '081684e1cd1244259c78f89a9eb6759b'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:36.505667 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 847/1665] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 22 20:56:36 2022] DELETE /identity/v3/users/081684e1cd1244259c78f89a9eb6759b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:56:36.792588 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bcb7d3-3d99-4571-a22b-312a9f42b2a1 service neutron] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:56:36.804459 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bcb7d3-3d99-4571-a22b-312a9f42b2a1 service neutron] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:56:36.862818 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb4a85-98c0-41c4-9a70-06ee13c73619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:56:36.863475 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb4a85-98c0-41c4-9a70-06ee13c73619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:56:36.863764 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb4a85-98c0-41c4-9a70-06ee13c73619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:56:36.864044 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fb4a85-98c0-41c4-9a70-06ee13c73619 admin admin] PATH_INFO: `/v3/projects/e8db37443fb545aa9f8cc4c73eed2ab6` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:56:36.875556 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb4a85-98c0-41c4-9a70-06ee13c73619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8db37443fb545aa9f8cc4c73eed2ab6)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:56:36.877534 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fb4a85-98c0-41c4-9a70-06ee13c73619 admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:56:36.995389 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-56fb4a85-98c0-41c4-9a70-06ee13c73619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8db37443fb545aa9f8cc4c73eed2ab6', 'request_id': 'req-56fb4a85-98c0-41c4-9a70-06ee13c73619'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:37.001128 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-56fb4a85-98c0-41c4-9a70-06ee13c73619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8db37443fb545aa9f8cc4c73eed2ab6', 'request_id': 'req-56fb4a85-98c0-41c4-9a70-06ee13c73619'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:37.071640 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-56fb4a85-98c0-41c4-9a70-06ee13c73619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8db37443fb545aa9f8cc4c73eed2ab6', 'request_id': 'req-56fb4a85-98c0-41c4-9a70-06ee13c73619'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:37.083916 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-56fb4a85-98c0-41c4-9a70-06ee13c73619 admin admin] The token cache is being invalidate because project e8db37443fb545aa9f8cc4c73eed2ab6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:56:37.084206 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-56fb4a85-98c0-41c4-9a70-06ee13c73619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:37.084952 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-56fb4a85-98c0-41c4-9a70-06ee13c73619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:37.086813 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 819/1666] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 22 20:56:36 2022] DELETE /identity/v3/projects/e8db37443fb545aa9f8cc4c73eed2ab6 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:56:37.091021 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756bf11-c77b-4e7b-b811-f338d12b84f4 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:56:37.092440 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-a756bf11-c77b-4e7b-b811-f338d12b84f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:56:37.105848 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756bf11-c77b-4e7b-b811-f338d12b84f4 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:56:37.163174 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a1687-7963-4031-8029-4ac0062f4f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:56:37.163794 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a1687-7963-4031-8029-4ac0062f4f16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:56:37.164076 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a1687-7963-4031-8029-4ac0062f4f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:56:37.164349 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a1687-7963-4031-8029-4ac0062f4f16 admin admin] PATH_INFO: `/v3/users/2d4fa322dfd64cd69966fd8a1214b62f` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:56:37.177801 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a1687-7963-4031-8029-4ac0062f4f16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d4fa322dfd64cd69966fd8a1214b62f)` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:56:37.179731 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a1687-7963-4031-8029-4ac0062f4f16 admin admin] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:56:37.344698 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-721a1687-7963-4031-8029-4ac0062f4f16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d4fa322dfd64cd69966fd8a1214b62f'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:37.349436 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:56:37.357379 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-721a1687-7963-4031-8029-4ac0062f4f16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d4fa322dfd64cd69966fd8a1214b62f'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:37.358119 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-721a1687-7963-4031-8029-4ac0062f4f16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d4fa322dfd64cd69966fd8a1214b62f'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:37.364751 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-721a1687-7963-4031-8029-4ac0062f4f16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d4fa322dfd64cd69966fd8a1214b62f'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:37.457018 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.notifications [None req-721a1687-7963-4031-8029-4ac0062f4f16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d4fa322dfd64cd69966fd8a1214b62f'} {{(pid=81637) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:37.463451 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 848/1667] 10.222.0.62 () {58 vars in 1224 bytes} [Mon Aug 22 20:56:37 2022] DELETE /identity/v3/users/2d4fa322dfd64cd69966fd8a1214b62f => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:56:37.678355 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb4a85-98c0-41c4-9a70-06ee13c73619 admin admin] Authenticating user token {{(pid=81638) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:56:37.679912 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.fernet_utils [None req-56fb4a85-98c0-41c4-9a70-06ee13c73619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81638) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:56:37.693658 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fb4a85-98c0-41c4-9a70-06ee13c73619 admin admin] Validating token access rules against request {{(pid=81638) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:56:37.707398 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:56:37.753539 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf28e1-690f-4336-814b-c3de0db05acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d89af55e2b04afa9fa5ae15b3027c4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7adb0f361d1a498f9e39b33b2bbe63ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81638) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:56:37.754169 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf28e1-690f-4336-814b-c3de0db05acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:56:37.754445 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf28e1-690f-4336-814b-c3de0db05acf admin admin] SCRIPT_NAME: `/identity` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:56:37.754712 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf28e1-690f-4336-814b-c3de0db05acf admin admin] PATH_INFO: `/v3/projects/3aa2429715cd4cabae0c2416494e20ed` {{(pid=81638) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:56:37.765014 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf28e1-690f-4336-814b-c3de0db05acf admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aa2429715cd4cabae0c2416494e20ed)` {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:56:37.766925 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf28e1-690f-4336-814b-c3de0db05acf admin admin] RBAC: Authorization granted {{(pid=81638) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:56:37.894287 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-6fcf28e1-690f-4336-814b-c3de0db05acf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aa2429715cd4cabae0c2416494e20ed', 'request_id': 'req-6fcf28e1-690f-4336-814b-c3de0db05acf'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:37.900317 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-6fcf28e1-690f-4336-814b-c3de0db05acf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aa2429715cd4cabae0c2416494e20ed', 'request_id': 'req-6fcf28e1-690f-4336-814b-c3de0db05acf'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:37.967550 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-6fcf28e1-690f-4336-814b-c3de0db05acf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aa2429715cd4cabae0c2416494e20ed', 'request_id': 'req-6fcf28e1-690f-4336-814b-c3de0db05acf'} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:37.981049 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-6fcf28e1-690f-4336-814b-c3de0db05acf admin admin] The token cache is being invalidate because project 3aa2429715cd4cabae0c2416494e20ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81638) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 20:56:37.981336 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-6fcf28e1-690f-4336-814b-c3de0db05acf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:37.981980 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG keystone.notifications [None req-6fcf28e1-690f-4336-814b-c3de0db05acf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81638) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 20:56:37.983473 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: [pid: 81638|app: 0|req: 820/1668] 10.222.0.62 () {58 vars in 1233 bytes} [Mon Aug 22 20:56:37 2022] DELETE /identity/v3/projects/3aa2429715cd4cabae0c2416494e20ed => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 20:56:47.557070 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:DELETE=3,keystone:SELECT=10,keystone:INSERT=1 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:56:47.980293 dv-osbrick-853789-1-iscsi devstack@keystone.service[81638]: DEBUG dbcounter [-] [81638] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81638) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 20:58:54.296135 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a1687-7963-4031-8029-4ac0062f4f16 admin admin] Authenticating user token {{(pid=81637) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 20:58:54.297639 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-721a1687-7963-4031-8029-4ac0062f4f16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:58:54.368787 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a1687-7963-4031-8029-4ac0062f4f16 admin admin] Validating token access rules against request {{(pid=81637) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 20:58:54.437223 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f733c-deda-490e-9861-76747f428b6e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3fdb2336b8b4f7c9b710b224a8594a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '783c362712d34405ab827e3f00a67995', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81637) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 20:58:54.437840 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f733c-deda-490e-9861-76747f428b6e service placement] REQUEST_METHOD: `GET` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 20:58:54.438125 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f733c-deda-490e-9861-76747f428b6e service placement] SCRIPT_NAME: `/identity` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 20:58:54.438392 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f733c-deda-490e-9861-76747f428b6e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81637) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 20:58:54.440191 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.fernet_utils [None req-ee4f733c-deda-490e-9861-76747f428b6e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81637) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 20:58:54.451926 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f733c-deda-490e-9861-76747f428b6e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 20:58:54.453546 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f733c-deda-490e-9861-76747f428b6e service placement] RBAC: Authorization granted {{(pid=81637) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 20:58:54.463233 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: [pid: 81637|app: 0|req: 849/1669] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Aug 22 20:58:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 20:59:04.459269 dv-osbrick-853789-1-iscsi devstack@keystone.service[81637]: DEBUG dbcounter [-] [81637] Writing DB stats keystone:SELECT=58 {{(pid=81637) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}